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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students' proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Georgia, 2,766 students in 105 
public schools and 217 students in 9 non-public schools were assessed. This 
report describes the reading proficiency of Georgia fourth-graders and 
compares their overall performance to students in the Southeast region of the 
United States and the nation (using data from the NAEP national assessments) . 
The distribution of reading results and reading achievement level results are 
provided for subpopulations of students (race/ethnicity, type of location, 
parents, educational level, and gender). Reading proficiency and achievement 
of non-public school students are separately reported and compared to public 
school students. To provide a context for the assessment data, participating 
public school students, their reading teachers, and principals completed 
questionnaires which focused on*, policies and practices related to reading 
(time for instructional activities and instructional resources for reading) ,* 
delivery of reading instruction (instructional materials and activities, 
workbooks/ worksheets/writing, discussion and group activities, time to read, 
reading and use of libraries, assessing progress in reading) ,* reading 
instructors (preparation, experience and professional development); students' 
home support for literacy (reading outside of school and in the home and 
hours of television watched per day) . The average reading proficiency of 
public school students in Georgia on the NAEP reading scale was 207 compared 
to 212 nationwide. (CR) 
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What is The Nation’s Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing 
assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in 
reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student performance available to 
policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. 
Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of individual students and their 
families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
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performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking 
actions to improve the form and use of the National Assessment. 
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EXECUTIVE 

SUMMARY 



In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics. 1 The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories. 2 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
students in Georgia, the Southeast region, and the nation. The distribution of reading 
proficiency results and reading achievement level results are provided for groups of 
students defined by shared characteristics: race/ethnicity, type of location, parents’ 
education level, and gender. Contextual information about reading policies, instruction, 
and home support for reading is presented for public school students. State results are 
based on the representative sample of students who participated in the 1994 Trial State 
Reading Assessment Program. Results for the region and the nation are based on the 
regional and national representative samples of students who participated in the national 
NAEP assessment. 

1 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The Stale of Mathematics Achievement: NAEP’s J990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

2 For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the Stales. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H, Owen, and Gary W. Phillips. NAEP J992 Mathematics Report Card for the Nation and the Stales. (Washington, 
DC: National Center for Education Statistics, 1993). 
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School and Student Participation in the Reading Assessment 

In Georgia, 105 public schools and 9 non-public schools participated in the 1994 
fourth-grade reading assessment. These numbers include participating substitute schools 
that were selected to replace some of the nonparticipating schools from the original 
sample. The weighted school participation rate after substitution in 1994 was 
99 percent for public schools and 84 percent for non-public schools, which means that 
the fourth-grade students in this sample were directly representative of 99 percent and 
84 percent of all the fourth-grade public and non-public school students in Georgia, 
respectively. 

In Georgia, 2,766 public school and 217 non-public school fourth-grade students 
were assessed in 1994. The weighted student participation rate was 95 percent for 
public schools and 97 percent for non-public schools. This means that the sample of 
fourth-grade students who took part in the assessment was directly representative of 
95 percent of the eligible public school student population and 97 percent of the 
eligible non-public school student population in participating schools in Georgia (that 
is, all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 95 percent 
and 81 percent for public and non-public schools, respectively. This means that the 
sample of students who participated in the assessment was directly representative of 
95 percent of the eligible fourth-grade public school population and 81 percent of the 
eligible fourth-grade non-public school population in Georgia. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public and 
non-public school fourth-grade students in Georgia. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Georgia met minimum participation levels for public 
and non-public schools. Hence, results for both types of schools are included in this 
report. Georgia met all other established NCES participation guidelines for public 
schools but failed to meet one or more of these guidelines for non-public schools. 
Georgia’s weighted participation rate for the initial samples of non-public schools was 
below 85 percent and the weighted school participation rate after substitution was below 
90 percent (see Appendix A). 
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Students’ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Georgia, the Southeast region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Georgia on the NAEP reading scale was 207. This average was lower 
than that of students across the nation (21 2). 3 The lowest performing 
10 percent of public school fourth graders in Georgia had proficiencies 
at or below 148 while the top 10 percent had proficiencies at or above 
260. In public schools across the nation, the lowest performing 10 
percent of fourth graders had proficiencies at or below 156; the top 
performing 10 percent of students had proficiencies at or above 261. 

1992 vs 1994, Public School Students 
There was no significant change in the average performance of 
fourth-grade public school students in Georgia from 1992 to 1994 (212 
in 1992 and 207 in 1994). During the same period, there was no 
significant change in the average performance of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



3 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table below provides 
results for Georgia, the Southeast region, and the nation according to each reading 
purpose. 



1994, Public School Students 

The proficiency of public school students in Georgia in reading for 
literary experience (208) was lower than that of students across the 
nation (214). However, in reading to gain information, the proficiency 
of public school students in Georgia (206) did not differ significantly 
from that of students across the nation (210). 

1992 vs 1994, Public School Students 
Georgia’s public school fourth graders showed a decline from 1992 to 
1994 in reading for literary experience. However, in reading to gain 
information, public school fourth graders in Georgia exhibited no 
significant change from 1992 to 1994. 
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The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given below. Chapter 3 provides further elaboration of these 
levels and presents examples of types of questions that students at each of the three 
achievement levels can respond to effectively. 



THE NATION'S 
REPORT ppp 
CARD ~ 



1994 Trial Stale Assessment 






m 



Description of Fourth-Grade Reading Achievement 
Levels 



Achievement 

Level 


Scale 

Cutpoint 


Description 


ADVANCED 


268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


: i 

(4|p: 

PROFICIENT 


238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


BASIC 4: 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Georgia who were at or 
above the Proficient level (26 percent) did not differ significantly from 
that of students across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Georgia who attained the Proficient level 
(25 percent in 1992 and 26 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students, 4 The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 



4 



: — 15 

Ina V.S. Mullis, John A. Dossey, Jay R, Campbell, Claudia A, Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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Race/Ethnicity 

1994 , Public School Students. The average reading proficiency of White 
students in Georgia public schools was higher than that of Black and 
Hispanic students. 

7992 vs 1994 y Public School Students. There was a decrease in the 
average reading proficiency of Black public school students in Georgia 
from 1992 to 1994. There was no significant change in the average 
reading proficiency of White or Hispanic public school students in 
Georgia from 1992 to 1994. 

Type of Location 

1994 , Public School Students. The average reading proficiency of 
Georgia students attending public schools in central cities was lower 
than that of students in urban fringe/large towns but was not 
significantly different from that of students in rural areas/small towns. 

7992 vs 1994 t Public School Students. From 1992 to 1994, there was 
no significant change in the average reading proficiency of students 
attending public schools in central cities, urban fringe/large towns, or 
rural areas/small towns in Georgia. 

Parents 9 Education Level 

1994 y Public School Students. Public school students in Georgia 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which did not differ significantly from 
that of students who reported that at least one parent had some education 
after high school but was higher than that of students who reported that 
at least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

7992 vs 1994 f Public School Students. The average proficiency of public 
school students in Georgia who reported that at least one parent 
graduated from college, at least one parent had some education after 
high school, at least one parent graduated from high school, neither 
parent graduated from high school, or they did not know their parents’ 
education level did not change significantly between 1992 and 1994. 

Gender 

1994 , Public School Students. In public schools in Georgia, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 

7992 vs 1994 , Public School Students. In Georgia public schools, the 
average reading proficiency for boys was lower in 1994 than in 1992. 
However, the average proficiency for girls did not change significantly 
from 1992 to 1994. 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 



17 



8 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Georgia 



Reading Performance of Non-Public School Students 

The 1994 Trial State Assessment marks the first time that non-public school 
students were assessed at the state level. Therefore, separate non-public school results 
can be reported for Georgia. Also, results based on a combined sample of public and 
non-public school students can be presented. The following table shows the distribution 
of overall reading proficiency for the non-public school and combined populations. The 
corresponding public school student results can be found in the table on page 3. 

Non-Public School Students 

The average reading proficiency of fourth-grade students in non-public 
schools in Georgia was 234. This average was not significantly different 
from that of non-public school students across the nation (231). 

Public and Non-Public School Student Comparison 
The average reading proficiency of fourth-grade students in non-public 
schools in Georgia was higher than the average for public school 
students (234 for non-public and 207 for public). For the nation, the 
average reading proficiency for non-public school students was higher 
than that of their public school counterparts (231 for non-public and 212 
for public). 

1994, Public and Non-Public School Students Combined 

The average reading proficiency of grade 4 students from Georgia was 
209. This average was lower than that of students across the nation 
(214). The lowest performing 10 percent of fourth graders from Georgia 
had proficiencies at or below 150 while the top 10 percent had 
proficiencies at or above 261. The lowest performing 10 percent of 
students across the nation had proficiencies at or below 159 while the 
top 10 percent had proficiencies at or above 263. 
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The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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A Context for Understanding Students’ Reading Proficiency in Public Schools 

Information on the reading performance of students in Georgia can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Georgia are as 
follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Georgia in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 

• According to the public school administrators in Georgia, in 1994, 

89 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was not 
significantly different from that of students across the country 
(85 percent). 

• In 1994, according to their reading teachers, 34 percent of the students 
in public schools in Georgia were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
lower across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Georgia whose teachers used both basal and trade books 
demonstrated an average reading proficiency (209) which did not differ 
significantly from* that of students whose teachers primarily used basal 
readers (203). 

• The proficiency of Georgia students whose teachers used both basal and 
trade books (209) was not significantly different from* that of students 
whose teachers primarily used trade books (216). 

• The proficiency of Georgia students whose teachers primarily used trade 
books (216) was higher than that of students whose teachers primarily 
used basal readers (203). 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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• In Georgia, 29 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines at least once a week; 
31 percent of the students had reading teachers who used reading kits 
at least once a week; 47 percent had reading teachers who used 
computer software for reading instruction at least once a week; 
75 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 70 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Georgia reading teachers, 67 percent of the students 
were asked to discuss new or difficult vocabulary almost every day. 
This percentage did not differ significantly from that of students across 
the nation (62 percent). 

• According to their reading teachers, the percentage of students in 
Georgia who were asked to talk with each other almost every day about 
what they have read (33 percent) was not significantly different from 
that of students across the nation, where 34 percent of the students were 
asked to do this activity almost every day. 

• According to the reading teachers in Georgia, 3 percent of the students 
were asked to do a group activity or project about what they have read 
almost every day. This figure was not significantly different from that 
of students across the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Georgia (48 percent) was not significantly different from* that for the 
nation (41 percent). 

• Less than one fifth of the students (17 percent) had reading teachers 
who had the highest level of teaching certification that is recognized by 
Georgia. This was smaller than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Georgia, 16 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was not significantly different from the percentage 
of students across the nation who were being taught by reading teachers 
with the same major (20 percent). 



0 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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HOME FACTORS 

• In Georgia, 32 percent of the students reported having four types of 
reading materials (a newspaper, an encyclopedia, 25 or more books, and 
magazines) in the home. This figure was somewhat lower than that for 
the nation (36 percent). Students in Georgia who had all four of these 
types of materials in the home showed an average reading proficiency 
(225) which was higher than that of students with zero to two types of 
materials (191). 

• In 1994 in Georgia, 31 percent of the students discussed with friends 
or family what they read almost every day. This percentage was 
somewhat greater than that of students across the nation (28 percent). 

The proficiency of students in Georgia who discussed what they read 
with friends or family almost every day (204) did not differ significantly 
from that of students who had discussions with friends or family less 
than weekly (207). 

• About one fifth of the fourth-grade students (22 percent) watched six 
hours or more of television each day. This was not significantly 
different from the figure for the nation, where 22 percent of the students 
watched this much television. Average reading proficiency in Georgia 
was lowest for students who spent six hours or more watching television 
each day. 

Comparisons of Overall Reading Proficiency in Georgia with Other States 

The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Georgia with that in 
other states (including Guam and the Department of Defense Education Activity 
[DoDEA] Overseas Schools) that participated in the NAEP 1994 Trial State Assessment 
Program. The different shadings of the states on the map show whether the average 
overall proficiency of public school students in the other states was statistically different 
from or not statistically different from that of public school students in Georgia (‘Target 
State”). States in black have a significantly lower average public school proficiency than 
does Georgia. States with a dark-gray shading have a significantly higher average public 
school proficiency than does Georgia. States with a light-gray shading have an average 
public school proficiency that does not differ significantly from that of Georgia. The 
significance tests are based on a Bonferroni procedure for multiple comparisons that 
holds the probability of erroneously declaring the means of any two states to be different, 
when they are not, to no more than five percent. Two states — Idaho and Michigan 
— did not meet minimum school participation guidelines for public schools. Another 
jurisdiction — Washington, DC — withdrew from the Trial State Assessment after the 
data collection phase. Therefore, these three jurisdictions are not included in the 
comparisons depicted on the map on the following page. 
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OVERVIEW 



F or over 25 years, the National Assessment of Educational Progress (NAEP) 
has been the nation’s primary indicator of student achievement, reporting on what 
students know and can do in various school subject areas at grades 4, 8, and 12. With 
legislation passed by Congress in 1988, NAEP’s mission of providing dependable and 
comprehensive information about educational progress in the United States was 
expanded to involve a voluntary state-by-state assessment on a trial basis. 

Consequently, the 1990 NAEP program included a Trial State Assessment 
Program in which public school students in 37 states, the District of Columbia, and two 
territories were assessed in eighth-grade mathematics. 5 Building on this initial effort, 
the 1992 NAEP program included a Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public school students assessed 
in 41 states, the District of Columbia, and two territories. 6 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students: 

The National Assessment shall conduct in 1994 ... a trial reading 
assessment for the 4th grade , in states that wish to participate , with the 
purpose of determining whether such assessments yield valid and 
reliable State representative data. ( Section 406(i)(2)(C)(i) of the 

General Education Provisions Act , as amended by Pub. L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 

The National Assessment shall include in each sample assessment . . . 
students in public and private schools in a manner that ensures 
comparability with the national sample. (Section 406(i)(2)(C)(i) of the 
General Education Provisions Act , as amended by Pub . L. 103-33 
(U.S.C. 1221e-l(a)(2)(B)(iii))) 




5 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and the Trial Assessment of the States. 

(Washington, DC: National Center for Education Statistics, 1991). 



6 



For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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In addition to the state assessment program in reading at grade 4, the 1994 NAEP 
involved national assessments of reading, geography, and history at grades 4, 8, and 12. 

The 1994 Trial State Assessment Program was conducted in February 1994 with 
the following 44 participants: 


Alabama 


Louisiana 


North Dakota 


Arizona 


Maine 


Pennsylvania 


Arkansas 


Maryland 


Rhode Island 


California 


Massachusetts 


South Carolina 


Colorado 


Michigan 


Tennessee 


Connecticut 


Minnesota 


Texas 


Delaware 


Mississippi 


Utah 


District of Columbia 


Missouri 


Virginia 


Florida 


Montana 


Washington 


Georgia 


Nebraska 


West Virginia 


Hawaii 


New Hampshire 


Wisconsin 


Idaho 


New Jersey 


Wyoming 


Indiana 


New Mexico 




Iowa 


New York 


Guam 


Kentucky 


North Carolina 


DoDEA 




Jurisdictions in italics — Montana, Washington, and the Department of Defense 
Education Activity (DoDEA) Overseas Schools — did not participate in the 1992 Trial 
State Assessment Program. Two states — Idaho and Michigan — did not meet minimum 
school participation guidelines for public schools. Another jurisdiction — Washington, 
DC — withdrew from the Trial State Assessment Program after the data collection 
phase. Therefore, public school results for these three jurisdictions are not reported. 
Three jurisdictions — Ohio, Oklahoma, and the Virgin Islands — participated in the 
1992 Trial State Assessment but not in the 1994 program. 

For the 1994 Trial State Assessment in reading, a combined sample of 
approximately 2,800 public and non-public school students was assessed in most 
jurisdictions. The samples were carefully designed to represent the fourth-grade 
populations in the states or jurisdictions. Participating jurisdictions were responsible for 
the administration of the assessment. For jurisdictions that participated in the 1992 Trial 
State Assessment Program, contractor staff monitored 25 percent of public school 
sessions and 50 percent of non-public school sessions. For jurisdictions that did not 
participate in 1992, contractor staff monitored 50 percent of both public and non-public 
school sessions. Monitoring efforts were part of a quality assurance program designed 
to ensure that sessions were conducted uniformly. 

The 1992 Trial State and National Assessment programs in reading were based 
on a framework developed through a national consensus process that was set forth by 
law and called for “active participation of teachers, curriculum specialists, subject matter 
specialists, local school administrators, parents, and members of the general public” 
(Pub. L. 100-297, Part C, 1988). 7 This same framework served as the basis of the 1994 
Trial State and National Assessment programs. 



7 



NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress . (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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The process of developing the framework was carried out in late 1989 and early 
1990 by the Council of Chief State School Officers (CCSSO) under contract from the 
National Assessment Governing Board (NAGB) which is responsible for formulating 
policy for NAEP, including developing assessment objectives and test specifications. 
The framework development process included gathering input from a wide range of 
people in the fields of reading and assessment, such as school teachers, administrators, 
and state coordinators of reading and reading assessment. After thorough discussion and 
some amendment, the framework was adopted by NAGB in March 1990. An overview 
of the reading framework is provided in Appendix A. 

The 1994 fourth-grade Trial State and National Assessments in reading consisted 
of eight sections or blocks, each 25 minutes in length. All fourth-grade students in the 
assessment were required to complete two blocks. Each block contained a passage or 
set of passages and a combination of constructed-response and multiple-choice 
questions. Passages selected for the assessment were drawn from authentic texts used 
by students in typical reading situations. Complete stories, articles, or sections of 
textbooks were used, rather than excerpts or abridgements. The type of question — 
constructed-response or multiple-choice — was determined by the objective being 
measured. In addition, the constructed-response questions were of two types: short 
constructed-response questions which required students to respond to a question in a few 
words or a few sentences and extended constructed-response questions which required 
students to respond to a question in a paragraph or more. 



This Report 

This is a computer-generated report that describes the reading performance of 
fourth-grade students in Georgia, in the Southeast region, and across the nation. A 
separate report describes additional fourth-grade reading assessment results for the nation 
and the states, as well as the national results for grades 8 and 12. 8 This report consists 
of four sections: 

• This Overview provides background information about the 1994 Trial 
State Assessment Program and a profile of the fourth-grade students in 
Georgia. 

• Part One shows the distribution of reading proficiency results for 
fourth-grade students in Georgia, the Southeast region, and the nation. 

• Part Two presents reading achievement level results for fourth graders 
in Georgia, the Southeast region, and the nation. 

• Part Three relates fourth-grade public school students’ reading 
proficiency to contextual information about the reading policies, 
instruction, and home support for reading in Georgia, the Southeast 
region, and the nation. 



8 See NAEP 1994 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1995). 
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In this report, results are provided for groups of students defined by shared 
characteristics — race/ethnicity, type of location, parents’ education level, and gender. 
Based on criteria described in Appendix A, data are reported for subpopulations only 
where sufficient numbers of students and adequate school representation are present. 
For public school students, there must be at least 62 students in a particular subgroup 
from at least 10 different schools. For non-public school students, the minimum 
requirement is 62 students representing at least 6 different schools. However, the data 
for all students, regardless of whether their subgroup was reported separately, were 
included in computing overall results for Georgia. Definitions of the subpopulations 
referred to in this report are presented below. 

The results for Georgia are based on the representative sample of students who 
participated in the 1994 Trial State Assessment Program. The results for the nation and 
the region of the country are based on the nationally and regionally representative 
samples of students who were assessed in January through March as part of the national 
NAEP program. Using the national and regional results from the 1994 national NAEP 
program is necessary because of the voluntary nature of the Trial State Assessment 
Program. Since not every state participated in the program, the aggregated data across 
states did not necessarily provide representative national or regional results. Specific 
details on the samples and analysis procedures used can be found in the Technical Report 
of the 1994 NAEP Trial State Assessment Program in Reading. 9 

Race/Ethnicitv 

Results are presented for students of different racial/ethnic groups based on the 
students’ self-identification of their race/ethnicity according to the following mutually 
exclusive categories: White, Black, Hispanic, Asian, Pacific Islander, and American 
Indian (including Alaskan Native). In 1992, the question posed to students regarding 
their racial/ethnic background had one Asian/Pacific Islander category. In 1994, these 
were two distinct response options for the question. Consequently, data and trend results 
for the separate categories are not available for the 1992 sample. 

Type of Location 

Results are provided for students attending public schools in three mutually 
exclusive location types — central city, urban fringe/large town, and rural/small town 
— as defined below. The type of location variable is defined in such a way as to indicate 
the geographical location of a student’s school. The intention is not to indicate, or 
imply, social or economic meanings for these location types. The type of location 
variable, given the current NAEP sampling, does not support the reporting of regional 
results. Therefore, only state and national results will be presented. 

Central City: The Central City category includes central cities of all 
Standard Metropolitan Statistical Areas (SMSA’s). 10 Central City is a 
geographic term and is not synonymous with “inner city.” 



O 
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Technical Report of the NAEP 1994 Trial State Assessment Program in Reading. (Washington, DC: National Center 
for Education Statistics, 1995). 
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Urban Fringe/Large Town: An Urban Fringe includes all densely 

settled places and areas within SMSA’s that are classified as urban by 
the Bureau of the Census. A Large Town is defined as places outside 
SMSA’s with a population greater than or equal to 25,000. 

Rural/Small Town: Rural includes all places and areas with a 

population of less than 2,500 that are classified as rural by the Bureau 
of the Census. A Small Town is defined as places outside SMSA’s 
with a population of less than 25,000 but greater than or equal to 2,500. 

Parents’ Education Level 

Students were asked to indicate the extent of schooling for each of their parents 
— did not finish high school, graduated from high school, had some education after high 
school, graduated from college, or did not know. The response indicating the higher 
level of education was selected for reporting. Note that a substantia] percentage of 
fourth-grade students did not know their parents’ education level. 

Gender 

Results are reported separately for males and females. 

Region 

The United States has been divided into four regions for purposes of this report: 
Northeast, Southeast, Central, and West. States included in each region are shown in 
Figure O.l. All 50 states and the District of Columbia are listed, with the participants 
in the 1994 Trial State Assessment Program highlighted in boldface type. Guam and 
the Department of Defense Education Activity (DoDEA) Overseas Schools were not 
assigned to a region. Further, students attending schools in the part of Virginia that is 
included in the Washington, DC, metropolitan statistical area are included in the 
Northeast regional results; students attending schools in the remainder of the state are 
included in the Southeast regional results. Because most of the Virginia students are in 
the Southeast region, regional comparisons for Virginia are to the Southeast. 

Regional results are based on national assessment samples, not on aggregated Trial 
State Assessment samples, as explained on the previous page. Thus, the regional results 
are based on a different and separate sample from that used to report the state results. 



3 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



19 



Georgia 



THE NATION’S 


REPORT 

CARD 


rai 




*- 




$1 







1994 Trial State Assessment 



FIGURE 0.1 

Regions of the Country 



NORTHEAST 


SOUTHEAST 


CENTRAL 


WEST 





Connecticut 


Alabama 


Illinois 


Alaska 


Delaware 


Arkansas 


Indiana 


Arizona 


District of Columbia 


Florida 


Iowa 


California 


Maine 


Georgia 


Kansas 


Colorado 


Maryland 


Kentucky 


Michigan 


Hawaii 


Massachusetts 


Louisiana 


Minnesota 


Idaho 


New Hampshire 


Mississippi 


Missouri 


Montana 


New Jersey 


North Carolina 


Nebraska 


Nevada 


New York 


South Carolina 


North Dakota 


New Mexico 


Pennsylvania 


Tennessee 


Ohio 


Oklahoma 


Rhode Island 


Virginia 


South Dakota 


Oregon 


Vermont 

Virginia 


West Virginia 


Wisconsin 


Texas 

Utah 

Washington 

Wyoming 



Note: Part of Virginia (near metropolitan Washington, DC) is included in the Northeast region, and the rest of Virginia 
is in the Southeast region. 



Non-Public Schools 

Samples for the 1994 Trial State Assessment Program were expanded to include 
students attending non-public schools (Catholic schools and other religious and private 
schools) in addition to the public school students. The expanded coverage was instituted 
for the first time in 1994. Samples for the 1990 and 1992 Trial State Assessment 
Programs had been restricted to public school students only. For those jurisdictions 
meeting pre-established participation rate standards (see Appendix A), separate results 
are reported for non-public schools and for the combined public and non-public school 
samples. The combined sample also contains students attending Bureau of Indian 
Affairs (BIA) schools and domestic Department of Defense schools. These two 
categories of schools are not included in either the public or non-public school samples. 
The DoDEA Overseas Schools are considered public schools and are reported as a 
separate jurisdiction for the first time in 1994. 



29 



20 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Georgia 



Guidelines for Analysis and Reporting 

This report describes reading performance for fourth graders and compares the 
results for various groups of students within that population — for example, those who 
have certain demographic characteristics or who responded to a specific background 
question in a particular way. The report examines the results for individual demographic 
groups and individual background questions. It does not include an analysis of the 
relationships among combinations of these subpopulations or background questions. 

Because the percentages of students in these subpopulations and their average 
proficiencies are based on samples — rather than on the entire population of fourth 
graders in a jurisdiction — the numbers reported are necessarily estimates . As such, they 
are subject to a measure of uncertainty, reflected in the standard error of the estimate. 
When the percentages or average proficiencies of certain groups are compared, it is 
essential to take the standard error into account, rather than to rely solely on observed 
similarities or differences. Therefore, the comparisons discussed in this report are based 
on statistical tests that consider both the magnitude of the difference between the means 
or percentages and the standard errors of those statistics. 

The statistical tests determine whether the evidence — based on the data from the 
groups in the sample — is strong enough to conclude that the means or percentages are 
really different for those groups in the population . If the evidence is strong (i.e., the 
difference is statistically significant), the report describes the group means or 
percentages as being different (e.g., one group performed higher than or lower than 
another group) — regardless of whether the sample means or sample percentages appear 
to be about the same or not. If the evidence is not sufficiently strong (i.e., the difference 
is not statistically significant), the means or percentages are described as being not 
significantly different — again, regardless of whether the sample means or sample 
percentages appear to be about the same or widely discrepant. The reader is cautioned 
to rely on the results of the statistical tests — rather than on the apparent magnitude of 
the difference between sample means or percentages — to determine whether those 
sample differences are likely to represent actual differences between the groups in the 
population. The statistical tests and Bonferroni procedure, which is used when more 
than two groups are being compared, are discussed in greater detail in Appendix A. 

In addition, some of the percentages reported in the text of the report are given 
quantitative descriptions (e.g., relatively few, about half, almost all, etc.). The 
descriptive phrases used and the rules used to select them are also described in 
Appendix A. 
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Finally, in several places in this report, results (mean proficiencies and 
percentages) are reported in the text for combined groups of students. For example, in 
the text, the proficiency of students in the combined group who reported reading for fun 
once or twice a month or never or hardly ever is given and compared to the group who 
reported reading for fun almost every day. However, the table that accompanies that text 
reports percentages and proficiencies separately for the four groups (almost every day, 
once or twice a week, once or twice a month, and never or hardly ever). The combined 
group proficiencies reported in the text and used in all statistical tests are based on 
unrounded estimates (i.e., estimates calculated to several decimal places) of the 
proficiencies for each group. The percentages shown in the tables are rounded to 
integers. Thus, percentages may not always add up to 100 percent due to rounding. 
Also, the percentage for a combined group (reported in the text) may differ slightly from 
the sum of the separate percentages (presented in the tables) for each of the groups that 
were combined. Therefore, if statistical tests were to be conducted based on the rounded 
numbers in the tables, the results might not be consonant with the results of the statistical 
tests that are reported in the text (based on unrounded numbers). 



Profile of Georgia 

Fourth-Grade School and Student Characteristics 

Table 0.1 provides a profile of the demographic characteristics of the fourth-grade 
students in Georgia, the Southeast region, and the nation. This profile is based on data 
collected from the students and schools participating in the 1992 and 1994 Trial State 
and National Assessments. As described earlier, the state data and the regional and 
national data are drawn from separate samples. 

Schools and Students Assessed 

Table 0.2 summarizes participation data for schools and students sampled in 
Georgia for both the 1992 and 1994 Trial State Assessments." In Georgia, 105 public 
schools and 9 non-public schools participated in the 1994 fourth-grade reading 
assessment. These numbers include participating substitute schools that were selected 
to replace some of the nonparticipating schools from the original sample. The weighted 
school participation rate after substitution in 1 994 was 99 percent for public schools and 
84 percent for non-public schools, which means that the fourth-grade students in this 
sample were directly representative of 99 percent and 84 percent of all the fourth-grade 
public and non-public school students in Georgia, respectively. 




For a detailed discussion of the NCES guidelines for sample participation, see School and Student Participation Rates 
for the Reading Assessment and Guidelines for Participation. (Washington, DC: National Center for Education 
Statistics, 1994); or see Appendix B of the Technical Report of the NAEP 1994 Trial State Assessment Program in 
Reading. (Washington, DC: National Center for Education Statistics, 1995). 
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In each school, a random sample of students was selected to participate in the 
assessment. In 1994, as estimated by the sample, 2 percent of the fourth-grade public 
school population and 0 percent of the non-public school population were classified as 
Limited English Proficient (LEP), while 10 percent in public schools and 3 percent in 
non-public schools had an Individualized Education Plan (IEP). An IEP is a plan, 
written for a student who has been determined to be eligible for special education, that 
typically sets forth goals and objectives for the student and describes a program of 
activities and/or related services necessary to achieve the goals and objectives. Students 
with disabilities may be categorized as IEP. 

Schools were permitted to exclude certain students from the assessment, provided 
that certain criteria were met. To be excluded, a student had to be categorized as 
Limited English Proficient or had to have an Individualized Education Plan and (in 
either case) be judged incapable of participating in the assessment. The intent was to 
assess all selected students; therefore, all selected students who were capable of 
participating in the assessment should have been assessed. However, schools were 
allowed to exclude those students who, in the judgment of school staff, could not 
meaningfully participate. The NAEP guidelines for exclusion are intended to assure 
uniformity of exclusion criteria from school to school. Note that some LEP and IEP 
students were deemed eligible to participate and not excluded from the assessment. The 
students in Georgia who were excluded from the assessment because they were 
categorized as LEP or had an IEP represented 6 percent of the public school population 
and 0 percent of the non-public school population in grade 4. 

In Georgia, 2,766 public school and 217 non-public school fourth-grade students 
were assessed in 1994. The weighted student participation rate was 95 percent for 
public schools and 97 percent for non-public schools. This means that the sample of 
fourth-grade students who took part in the assessment was directly representative of 
95 percent of the eligible public school student population and 97 percent of the 
eligible non-public school student population in participating schools in Georgia (that 
is, all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 95 percent 
and 81 percent for public and non-public schools, respectively. This means that the 
sample of students who participated in the assessment was directly representative of 
95 percent of the eligible fourth-grade public school population and 81 percent of the 
eligible fourth-grade non-public school population in Georgia. 
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TABLE 0.1 

Profile of Fourth-Grade Students in Georgia , the 
Southeast Region, and the Nation 



1994 Trial State Assessment 




1992 




1994 








Public 


Public 


Non-Public 


Combined 


Demographic Subgroups 

RACE/ETHNICITY 




Percentage 

: WZ?‘ 




Georgia 


White 


57(1.9) 


56(2.6) 


67 ( 3.3) 


58(2,4) 

:..'30(2-4)'.. 




Black 


34(1.8) 


32 ( 2J2) • 
fr'9X0.8)V 


5 ( 2.2) 




Hispanic 


• 5 (. 05) 


5 (1.4) 






Asian 


• 


i ; 2(0.3) 


1 (:i.O) 


2(0l3): 




Pacific Islander 


. 


i 0(0.1) 


0 ( O.S) 


M. .0(0.1);: 




American Indian 


1- HliJOSJ t 


1(02) 


:• 2 (i 0 : 8 )r| 


|»1: f 


Southeast 


White 


63(2:7): 


M*63'( 3.6) 


76 ( 65) f; 


^64(%0): i- 




Black 


29 ( 2 .6 ) V 


r|:26.( 2.9) -1 - 


12 ( 5.7) n 


; ; ":,25 




Hispanic 


5(11) 


;;;>:8;.(iJ2) i 




Sl^8;{'4^)4!-- 




Asian 


; 






^1(02) 




Pacific Islander 






wm 


0(0.1) 




American Indian 


!!#( 0.3)::|;4 




1 (0.3) 


Nation 


White 


69(115) ’ 


;: t : :68;( 05) : 


' : 76fi3S)^‘ 


69 ( 07) 




Black 


17(0.4) 


jH:16 ( 0.4) 


8(2.9) 3 


k-15 ( :0:2) , : 




Hispanic 


10(0.3) 


II 12 : (03) >v 

1142 


11(1.6) 


Ski..<pg^; 




Asian 


— («-.-) 




ll€xifii)^ 




Pacific Islander 






^ • %“(0.4) 






American Indian 


.Hi®?) ;; 




. M( o.6).;;| 


2(07) 


TYPE OF LOCATION * 






i IPS? fill 




Georgia 


Central City 


-24( 27) ? 




' 48 (19.8) f- 


21 (2.4) 




Urban Fringe/Large Town 


38 ( 3 7) " 


3:43 X 


. 28 (16.5) 


42 ( 3.9) 




Rural/Small Town 




fl38.!X35)|i 


24(17.1) 




Nation 


Central City 


; 32 ( 2.8) % 




'i 


35(2.0) 




Urban Fringe/Large Town 


41X35) '' 




- -47(46)., J 


843.(i2^)S- ; . 




Rural/Small Town 


i^|f|i §| wM 








PARENTS’ EDUCATION 




f\ "■ l\ 








Georgia 


Graduated college 


38 $1.3) ';i 




70(5.7} 






Some education after high school 




ISSlii 


8 ( 3.7) 


8(0.8) 




Graduated high school 




l®s. ( I0|^ 


': r 5«H!9) is f 


■'it4( s *0).:? 




Did not finish high school 


16X05) 


:;!S6.(0.7jf: i 


#AP)-:|- 






1 don't know 


$ &mm4 




-18 ( 5.8) 


:30(ia) : 


Southeast 


Graduated college 




^35 (.2.6) SB 




36(2.0) 




Some education after high school 


^05) 


Iptiifi ; 








Graduated high school 


!;:16X4i2) | 




. 10 ( 3.7). >:•; 


, 16(1.1} 




Did not finish high school 




6(0.9) 








1 don't know 


3SC2.0) 


i |34X l4f?J 


26(3.8)> 


1: 33( ii'4) ! ' 


Nation 


Graduated college 


a 


;v$(05>? = 


.;55ji21)(| 


42(p.9) ;o 




Some education after high school 






8(0.5) 




Graduated high school 


13X0.6) - 


;;:T3 : ( 05) ' 


. afM’o) •: 






Did not finish high school 


4:f04) 


0V4jI,' 


2 ( 0.6) 


ii 4( R3) j. 




1 don't know 


; :37i(rni):-l 






] 34 ( 0.8) 


GENDER 




' *" * 


’ 


•? * jv;?... >&£>•:£. cwx v < 




Georgia 


Male 


51XW) • 


‘■JiWXW" f 


39 ( 3,0) 0 


: 48(1.0) ;• 




Female 






.61. ( 3.0) : 


52 ( T.O) ; 


Southeast 


Male 




£8p :f 


■ '45X3l5) ;: 1 


JV'51-|l||f ; '- 




Female 


51|15) 




55(35) 




Nation 


Male 


i;:Sl ; #0.7)p 


|:51X 07)?G 




iisiitoSi 




Female 








49 ( 0.7) 



— Separate statistics for Asian and Pacific Islander students were not available in 1992. * School sample size is 

insufficient to permit reliable regional results for type of location. The standard errors of the statistics appear in 
parentheses. It can be said with about 95 percent confidence that, for each population of interest, the value for the entire 
population is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the 
standard error of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for 
public school students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence 
level. The percentages for Race/Ethnicity may not add to 100 percent because some students categorized themselves as 
“Other.” 
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Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public and 
non-public school fourth-grade students in Georgia. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Georgia met minimum participation levels for public 
and non-public schools. Hence, results for both types of schools are included in this 
report. Georgia met all other established NCES participation guidelines for public 
schools but failed to meet one or more of these guidelines for non-public schools. 
Georgia’s weighted participation rate for the initial samples of non-public schools was 
below 85 percent and the weighted school participation rate after substitution was below 
90 percent (see Appendix A). 

In the analysis of student data and reporting of results, nonresponse weighting 
adjustments have been made at both the school and student level, with the aim of making 
the sample of participating students as representative as possible of the entire eligible 
fourth-grade population. For details of the nonresponse weighting adjustment 
procedures, see the Technical Report of the NAEP 1994 Trial State Assessment Program 
in Reading. 
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TABLE 0.2 

Profile of the Fourth-Grade Population Assessed in 
Georgia 



1994 Trial State Assessment 



1992 

Public 



Public 



1994 

Non-Public 



SCHOOL PARTICIPATION 

Weighted school participation rate before substitution 

Weighted school participation rate after substitution 

Number of schools originally sampled 

Number of schools not eligible 

Number of schools in original sample participating 

Number of substitute schools provided 

Number of substitute schools participating 

Total number of participating schools 

STUDENT PARTICIPATION 

Weighted student participation rate after makeups 

Number of students selected to participate in the 
assessment 

Number of students withdrawn from the assessment 

Percentage of students who were of Limited English 
Proficiency 

Percentage of students excluded from the assessment 
due to Limited English Proficiency 

Percentage of students who had an Individualized 
Education Plan 

Percentage of students excluded from the assessment 
due to Individualized Education Plan Status 

Number of students to be assessed 

Number of students assessed 

Overall weighted response rate 



trioo%ifef 

100% 

109 
• 2 
107 

ISISSI 

0 : ,':V. 



3.193 






1 % ; 

iiiSli 



5% 

f 

z,&32 '* 1 $; 






p|-:;99%-; - 
S; : i;99% •; y : 
f*:yi07 " •; 

J§jy<>5 1 ' : 

• II 
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'■ , <> /0 / v 

SI - 






74% •••i:/; 

M%|g; 

* 

3 

;lN I ' 

9 




^ <■ ' • I'"'- 

~'$88gi 







,1^2,901 r 225 



7 1 99jsm<i 81% . 



Georgia failed to meet established NCES participation guidelines for non-public schools. Georgia’s 1994 non-public 
school weighted participation rate for the initial sample of schools was below 85% AND the weighted school participation 
rate after substitution was below 90%. In 1994 the materials from one public school in Georgia that conducted an 
assessment were lost in shipping. The school is included in the counts of participating public schools, both before and 
after substitution. However, in the weighted results, the school is treated in the same manner as a nonparticipating school 
because no student responses were available for analysis and reporting. 
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PART ONE 



The Reading Proficiency of Fourth-Grade 
Students in Georgia 

I^eading involves the interaction between and among a reader, a text, and a 
situation. 12 Thus, students’ reading comprehension is influenced by the type of material 
read and the specific purposes for reading. The 1994 Trial State Assessment Program 
considered students’ proficiency in situations that involved reading different kinds of 
materials for different purposes. The fourth-grade reading assessment measured two 
global purposes for reading — reading for literary experience and reading to gain 
information . 13 Students’ proficiency on each of the two purposes for reading was 
summarized on separate NAEP reading scales (one for each purpose), which range from 
0 to 500. In addition, results for an overall reading scale reflecting average proficiency 
across the two purposes for reading are also presented. The overall reading scale also 
ranges from 0 to 500. 

This part of the report contains two chapters that describe the reading proficiency 
of fourth-grade students in Georgia. Chapter 1 compares the overall reading proficiency 
of public school students in Georgia to the Southeast region and the nation. It also 
presents the students’ average proficiency for the two purposes for reading. Chapter 2 
summarizes reading proficiency for subpopulations of public school students defined by 
race/ethnicity, type of location, parents’ education level, and gender. The second chapter 
also provides the combined results for public and non-public school students, as well 
as the results for only non-public school students. 14 



12 _ 

J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 

Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 

13 

The eighth- and twelfth-grade national NAEP reading assessments also measured a third purpose for reading — reading 
to perform a task. 

14 Due to the relatively small sample size for the non-public school students, results are not reported by subpopulation. 
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CHAPTER 1 



Students’ Reading Proficiency 

In 1994, renewed emphasis was placed on national education goals when Congress 
reauthorized the Elementary and Secondary Education Act (ESEA) and enacted the Goals 
2000: Educate America Act. A concern for higher academic standards is evident in the 
ESEA’ s efforts to provide programs to improve America’s schools. Goals 2000 reasserts 
the importance of establishing and meeting rigorous goals in the education of our 
nation’s students — All students will leave grades 4, 8, and 12 having demonstrated 
competency over challenging subject matter including English , mathematics, science, 
foreign languages, civics and government, economics, arts, history, and geography, and 
every school in America will ensure that all students learn to use their minds well, so they 
may be prepared for responsible citizenship, further learning, and productive employment 
in our nation *s modem economy. Reading ability can be viewed as an enabling skill for 
reaching these goals. Therefore, concern about attaining these goals and, more 
specifically, about the reading abilities of our nation’s students has increased because 
recent NAEP results appear to indicate that many students of all ages have difficulty 
reading thoughtfully. 15 

The NAEP Reading Framework underlying both the 1992 and 1994 assessments 
views reading as a dynamic, complex interaction between and among the reader, the text, 
and the context of the reading experience. Readers, for example, bring to the reading 
process their prior knowledge about a topic, their reasons for reading, their individual 
reading skills and strategies, and their understanding of differences in text structures. 16 

The texts used in the NAEP reading assessment are representative of common 
reading demands. Because reading performance varies in response to texts and contexts, 
the NAEP assessment measured students’ abilities to read different types of materials 
for different purposes. The texts were selected from naturally-occurring sources that are 
typically available to children in and out of school. Students in grade 4 were asked to 
respond to literary and informational texts, corresponding with the two purposes for 
reading assessed at grade 4 — reading for literary experience and reading to gain 
information. 



15 Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993); Ina V.S. Mullis, John A. Dossey, Jay R. 
Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. NAEP 1992 Trends in Academic 
Progress. (Washington, DC: National Center for Education Statistics, 1994). 

16 J.A. Langer. “The Process of Understanding: Reading for Literary and Informational Purposes,” in Research in the 
Teaching of English, 24. (1990). pp. 229-260; NAEP Reading Consensus Project. Reading Framework for the 1992 
and 1994 National Assessment of Educational Progress. (Washington, DC: National Assessment Governing Board, 
U.S. Department of Education, 1994). 
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Reading for literary experience typically involves the reader in vicarious 
experiences through the story’s characters or considerations of how the author explores 
human events. Literary texts include short stories, poems, and folktales that engage the 
reader in a variety of ways, not the least of which is reading for fun. Reading to gain 
information may involve seeking to learn about a topic or to search for specific 
information. Informational texts include selections from textbooks, magazines, 
encyclopedias, and other written sources whose purpose is to increase the reader’s 
knowledge. Differences between narrative and informational text typically require 
students to use different skills and strategies. 

In addition to having fourth graders demonstrate their ability to read for two 
different purposes, the assessment asked students to build, extend, and examine meaning 
from four stances or types of interactions with the text. 



Students are asked to extend the ideas in the text by making inferences 
and connections. This includes making connections between cause and 
effect, analyzing the motives of characters, and drawing conclusions. 

Personal Response 

Students are asked to make explicit connections between the ideas in the 
text and their own background knowledge and experiences. This 
includes comparing story characters with themselves or people they 
know, or indicating whether they found a passage useful or interesting. 



Students are asked to consider the text objectively. This includes 
identifying how the author crafted a text with stylistic devices such as 
mood and tone. 

These stances are not considered hierarchical or completely independent of each 
other. Rather, they are viewed as recursive processes that take place throughout reading 
and represent different dimensions of the reader’s understanding. They provide a frame 
for generating assessment questions and considering student performance at all levels. 
All students at all levels should be able to respond to reading selections from all of these 
stances. What varies with students’ developmental and proficiency levels is the amount 
of prompting or support needed to elicit their responses, the complexity of the texts to 
which they can respond, and the sophistication of their answers. 

This chapter describes the reading proficiency of Georgia’s public school fourth 
graders in 1994 and the comparative results of their regional and national counterparts. 
In addition, this chapter provides a comparison of reading performance in 1992 and 1994 
for Georgia’s fourth graders attending public schools. 



Initial Understanding 



Students are asked to provide the overall or general meaning of the 
selection. This includes first impressions, main points, or themes. 



Developing an Interpretation 



Critical Stance 
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Table 1.1 shows the distribution of reading proficiency of fourth-grade students 
attending public schools in Georgia, the Southeast region, and the nation. 

1994 , Public School Students 

The average reading proficiency of fourth-grade public school students 
in Georgia on the NAEP reading scale was 207, This average was lower 
than that of students across the nation (21 2). 17 The lowest performing 
10 percent of public school fourth graders in Georgia had proficiencies 
at or below 148 while the top 10 percent had proficiencies at or above 
260. In public schools across the nation, the lowest performing 10 
percent of fourth graders had proficiencies at or below 156; the top 
performing 10 percent of students had proficiencies at or above 261. 

1992 vs 1994, Public School Students 
There was no significant change in the average proficiency of 
fourth-grade public school students in Georgia from 1992 to 1994 (212 
in 1992 and 207 in 1994). During the same period, there was no 
significant change in the average proficiency of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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TABLE 1.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




1992 


i 4. t Jf* 




*?-?**>■ 






^>4- % 4- 4# 


Georgia 


i 2t2( isr T' 


1* 


il88(2.3f 


*214(1 






Southeast 


- § 


163(30) ; f 




213(34** 


■ 235 ( 27ft 


: 254 “I 


Nation 




1«e( t:;9)r^ 


^*192 •( 1;0) 


mrfwrf'f 


' ;240( it3) ; 


259 :|2pJ ;; 


1994 


' % ■ T * - f. 


*4. .■£. ;r 'H* f?' 






... 7 >. * : . . 


^.x§J 


Georgia 


207(24 y. 


146 ( 3.9)1 < 


!l79(2.6)< 


210 (3rlX 


:289(Z0 l\l 


■ 260(22) V 


Southeast 


: 208 ( 2.0) 1” 


rt54(34r : f 


^181 ( 3.0) 


:$11(20) 


( £9) •; 


''257 { 1J);, ;i 


Nation 


212(1.1)* ^ 


156(2.1)<f 


; 187 ( 1.5) < 


21 7 ( I l2>' 


241 < 


261 (10); 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for ihe sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (1 ower) than the value for 1992 at about the 95 percent confidence level. 
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17 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Proficiency According to Purpose for Reading 

As previously indicated, the questions in the 1994 Trial State Assessment Program 
covered two purposes for reading at grade 4 — reading for literary experience and 
reading to gain information. Table 1.2 provides results for Georgia, the Southeast 
region, and the nation according to each reading purpose. 

1994, Public School Students 

The proficiency of public school students in Georgia in reading for 
literary experience (208) was lower than that of students across the 
nation (214). However, in reading to gain information, the proficiency 
of public school students in Georgia (206) did not differ significantly 
from that of students across the nation (210). 

1992 vs 1994, Public School Students 
Georgia’s public school fourth graders showed a decline from 1992 to 
1994 in reading for literary experience. However, in reading to gain 
information, they exhibited no significant change from 1992 to 1994. 
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TABLE 1.2 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 





Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Reading for Literary Experience 






tl;|v 














1992 Public 




















Georgia 


; Jisi 


Si; 




y 




XM%. 






pigs 


Southeast 


Uatef (. 24 JX 5 


164 






£215 ( 2.7)^; 






i257 : 


(2.6) • 


Nation 




: im 


MS 


194(12). 








262 


(1-6) 3 


1994 Public 












5 | 








Georgia 






9'(2.6) < 




r§4o 




262 


(2^) 


Southeast 


210>( 2.3); i'.; 


mm 


imm 


184 ( 3.1) ; 




f : 233: 




t$60 : 


(2,7)::: 


Nation 




■ 157 




189 ( 1 . 6 ) : 








264 




Reading to Gain Information 






i, Jj* j 






; 45 








1992 Public 










3 ft 4 ^ 






' 




Georgia 


5)& 


160 












257 


fPG 


Southeast 


208(2.7) 


4159, 




: x210'(;3^)-4 


5234? 




255 


( 3 6) fc 


Nation 




•|162: 




187 ( 1.4) 




238 




259 


;(JSg J 


1994 Public 


4' 'ft!: 










4 *5 








Georgia 


206 ( 2.5) L 


|l46. 






208 ( 2.9) 


: IsS 




*'2&3 




Southeast 


205 < 2.0) f v ; 


149 




178(23) 


207 ( 2.1) / 


• 23 *; 


(1.6). , 


,257 


wn? 


Nation 






:(:2.0);<| 




214(1.5) ! 

'f- H 


240 


fiS 


262 


(14) > 



The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. 
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CHAPTER 2 



Reading Proficiency of Fourth-Grade 
Students by Subpopulations 

The overall reading proficiency of students across the country presented in the 
previous chapter provides a global view of the state of reading performance. However, 
it is also important to look more closely at the performance of subgroups and to consider 
how different groups of children are progressing in reading. This information can 
provide educators, policy makers, and concerned citizens with important knowledge 
about how well students from different backgrounds and with different experiences are 
developing as readers. 

The 1994 Trial State Assessment Program provides additional information about 
the reading proficiency of important subpopulations by reporting on the performance of 
various subgroups of the public school student population defined by race/ethnicity, type 
of location, parents’ education level, and gender. In addition, because non-public school 
students were sampled in the 1994 Trial State Assessment Program, the results for 
non-public school students as well as those for the combined public and non-public 
school populations are reported. 

Race/Ethnicity 

The 1994 Trial State Assessment Program results for different racial/ethnic groups 
can be compared when the number of schools and students in a racial/ethnic group is 
of sufficient size to be reliably reported. (See Appendix A for details.) Table 2.1 
presents reading proficiency results for White, Black, and Hispanic fourth-grade public 
school students from Georgia. 

1994, Public School Students 

As shown in Table 2.1, the average reading proficiency of White 
students in Georgia public schools was higher than that of Black and 
Hispanic students. 
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1992 vs 1994 , Public School Students 
There was a decrease in the average reading proficiency of Black public 
school students in Georgia from 1992 to 1994. There was no significant 
change in the average reading proficiency of White or Hispanic public 
school students in Georgia from 1992 to 1994. 
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TABLE 2.1 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Race/Ethnicity 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 






White 




1 .' §•? i # • 


: ij* . v|\. I,;;. . 




1992 


Georgia 

Southeast 

Nation 


224 (1,4) * 180 ( 2.6) r. ' 2L 

220 ( 34) ‘'if 177- (67) 

••• ;::£2« 


>3 ( 1.3) # ‘ 226 ( 1.4) \ 247 ( 1.4)' $ 264 

» ( 4.2) 9' ■ 222 ( 3J3) ; "• 242 { 32 ) t 261 

>2 ;( 1 &)3r • , 225 246 fcl.3) . i 264 


(1.7); 

C-ii 


1994 

Black 


Georgia 

Southeast 

Nation 


222(1.9}>4 -^73(69) |-o 15 
219 ( 2.4) 170 ( 4.7) 1< 

223 ( 1.3) 175 ( 2.3) 2( 


19 (:2;1);V . 225 ( 2.4) 249.( 2,2) ,| 268 ( 2.3); * 

)6 ( 3.5):; • ' 222 { 3.7) 244 ( 22 ) f 264 ( 4.0) 

>1 ( 1.7) 226(1.4) 247(1.1). 266 ( 2.4) 


1992 


Georgia 

Southeast 

Nation 


,l96(2i)rS.-154.('2^)' h 
194 .(2.4) 150( 7 2) V, 

192(1.6) ; 148(65) M 


?*( 2,4)#:. i 197 11216^.6) : 237. 

>2 < 2-9) lr 1 i'' : 1 95 ( SstjRT "#216 ( 3.1) - 237 

59 :{ 60)#/ • : ; 193 (2X>) 215 ( 2,6) 235 


(W" n 


1994 


Georgia 

Southeast 

Nation 


-l85:-(.3 .2) - 130 

, 18* { &5) 139(2.1) ~ >U 

186 ( i!T) <r 135( 3.1) 


53;(-2.8># > :: 189 ( 3.6) ; ; -.p,2l5 (.2.9) 1:; 236 

50 ( 1.9) 187 (1.9) 213 ( 22) 234 




Hispanic 


i v * h ' piv ' „ - 


: qp .. 


^ * 


1992 


Georgia 

Southeast 

Nation 


••*192 {*&) 'b< 140 (;4j6) > 4 
194 < 5.0)!# 141 (25.9)1 * ; M i< 

199(2.2) 151 (4.2) 


3il(l4^!fe#l9b ( 3.4) : #.; \.k221.<(:4.0) • ; £ 246 
5?:(7,5)f 196 ( 4.4)1 223 ( 3.7)1 ? 241 

7S { 2.4) . 200 ( 3.7) 225,(3.9) ,245 


.(?i5);.’ j 
<6:2)1 :1| 

£2^;-§ 


1994 


Georgia 

Southeast 

Nation 


184 ( 5.7) 118(14.0) 1i 

>1 88 ( 2,7),<l , 134(4.7) ' 


53(3.3) 189(5.3) 222(8.7) 244 

(4.3)^4;-235 

50 ( 3.5) < 189(42) 217(3.5) 242 


{ 5 . 9 ) ^ I 

mmi 

|3.f5| 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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Type of Location 

Table 2.2 presents the reading proficiency results for fourth-grade students 
attending public schools in central cities, urban fringe/large towns, and rural areas/small 
towns. 



1994, Public School Students 

The results indicate that the average reading proficiency of Georgia 
students attending public schools in central cities was lower than that 
of students in urban fringe/large towns but was not significantly different 
from that of students in rural areas/small towns. 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the average 
reading proficiency of students attending public schools in central cities, 
urban fringe/large towns, or rural areas/small towns in Georgia. 
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TABLE 2.2 

Distribution of Rending Proficiency for Fourth-Grade 
Public School Students by Type of Location 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


Central City 




4 


K*. ..J4 : iK 




4,* 






1992 


Georgia 




l, 156('3.8} li 


4 179(4.1}^ • 


204(4^4). 


; *4 


228 ( 4j0) j 


: v. 250- (7.4) 




Nation 


207 ( I S) 


159 (2.6) 


183 ( 2.6) ; 


•209 ( i:9) 




232(1.9) ;.j 


253 (2.6)^ ; 


1994 


Georgia 


196 ( 57) : 


: : tsifasy ’ • 


164 ( mjt* : 


197 ( 74) 




229 ( 7^6) j 


257 ( 8.7>r 




Nation 


.^203:(-2.4):^ 


r 145 ( 2.6) < 


; 174 ( 3;1)4 ' 


,mB% 30) 




'• 235( 2:7) • 4 


256 (7.0)1 ; : 


Urban Fringe/Large Town 


• < • l. . . : l.| ' ' '.it 


• • ;• . wi.'.-s 


k. • k 


L -i ii- 




■ : .. j 


1 


1992 


Georgia 


3l9;< 2.3) 


rmor 


-497(14)1"'' 






■ 


261 (3.0)1” 1 




Nation 


:J21: 




^19642.Q)jj:r 


222 (2.6)' 




245 (1.9) ; $ 


• 263 : (4^;«i i 


1994 


Georgia 


• •21.3: (4.8)^ U 




;/185 ( 5i4)i-. 


1218(4:5) 


j-. 


245’ ( 4,2)? 4 


• =. 266 (5.1)fc j 




Nation 


219 ( i4) 


166(4.1) 1 


; 196 ( 3.0) -t; 


223(13) 




246(1.7) ; 


265 ( 3.0) • 


Rural/Small Town 




t 




4: xf'+p*' 






h * vV 


1992 


Georgia 




164 (14.0) , 


*4* ki&qfe* 


:213-( 2.3) 




236(27) 


. -256 




Nation 


■ ;2T7:< 25) ' 


173 ( 2,8) 


496(414) 


220 { 27) 




240 ( 2.4) 


258 ( 3.9): 


1994 


Georgia 




T^('3.4f v ' = 


* 179 ( 3.6) P ‘ 


208(37) 




234 ( 2.6) 


255 ( 2.3) 




Nation 


.^13.^14);,^ 


162(3.0) 


* 189 ( 2 . 8 ) 4 , 


1217.(1,8), 




240(24). :j 


260(2.1):( i 



School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Parents’ Education Level 

Previous NAEP findings have shown that students who report their parents are 
better educated tend to have higher reading proficiency. 18 Table 2.3 shows the results 
for fourth-grade public school students reporting that at least one parent graduated from 
college, at least one parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, or they did not 
know their parents’ education level. Note that a substantial percentage of fourth graders 
indicated that they did not know their parents’ education level. Furthermore, research 
suggests that some fourth graders’ reports on parents’ education level are almost 
certainly not accurate descriptions of their parents’ actual education levels. 19 Such 
considerations should be kept in mind when interpreting fourth grade proficiency results 
for different parental education levels. 

1994, Public School Students 

As shown in Table 2.3, public school students in Georgia reporting that 
at least one parent graduated from college demonstrated an average 
reading proficiency which did not differ significantly from that of 
students who reported that at least one parent had some education after 
high school but was higher than that of students who reported that at 
least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

1992 vs 1994, Public School Students 
The average proficiency of public school students in Georgia who 
reported that at least one parent graduated from college, at least one 
parent had some education after high school, at least one parent 
graduated from high school, neither parent graduated from high school, 
or they did not know their parents’ education level did not change 
significantly between 1992 and 1994. 
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Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstmp. The NAEP 1992 Reading Report Card for the Nation and the 
States. (Washington, DC: National Center for Education Statistics, 1993.) 

19 

E. Dianne Looker. “Accuracy of Proxy Reports of Parental Status Characteristics,” in Sociology of Education, 62(4). 
(1989). pp. 257-276. 
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TABLE 2.3 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Parents’ Level of Education 



1994 Tnal State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


College graduate 




V; • ' ! 


r |_ if; 


'■ v : 


1 i’4-H f • : 


' • " • ; 


1992 


Georgia 


221 (£2) 


173 (4.6) 


11 98(1.6) 


1:224 ;(2.3) : 


246 ( 2.2) 


264(29) 




Southeast 


218(2.8) 


171 (4.5) r 


194 ( 4.6) 


221 ( 2.4) 


244(4.8) 


264 ( 4.1) 




Nation 


223(1.6) 5 


175 ( 3.5) 


200 ( 2.1) 


226(2.1) 


249 (1.4) 


267(2.4) ; 


1994 


Georgia 


217(2,9) 


156 (5.3) 


188 ( 4.7) 


• 222(3.1) 


249 ( 4.3) 


270 ( 3;1)P 




Southeast 


216(3.0) 


,160(3.3)^ 


190(5.0) 


,219(3.7) 


245 ( 3.5) 


265 ( 2.8) 




Nation 


222(1*4)1;:^ 


: 168 ( 1.9): ig 


;i1:99(. 1.4) V 


; V:227;(:'1..7) 


249(1.8) :; , 


269(1.6) 


Some education after HS 




t:. 


V f- ’ ■ ’ 




x. •• 


•'i* 


1992 


Georgia 


2i9(3;lp" ;v 


166 (15.1): ?- 


193(5.9) 


219(10.0) 


247(5.3) 


267 ( 4;0) ; 




Southeast 


216(47)1 


167(7.1) 


194 ( 8.4) 


216 ( 52) 


241 ( 79) 


259 (11. OK 




Nation 


221 (2.4)^, 


177(9.0) ; 


201 ( 3.3) 


223 < ZS) 


245 ( 3.6) 


264 ( 7.5) : 


1994 


Georgia 


219(32) 


168 ( 44) i 


192(5.6) 


221 ( 4.1) 


246 (3.4) 


266 ( 9.4)f 




Southeast 


222 ( 3.0) V 


; 173 ( 7.0) 


199^20.4) 


226 ( 7.8) 


248 ( 6.7) 


269 (10.8)- "> 




Nation 


,222 v- 


VI 71 (9,6)||f 


[f09l(A3y :r ;t] 


226(33) ; 


..246|(l3|i).;; 


266 ( 3.9) 

- » 


High school graduate 


1 


v Hcfj 


Wt:- - * ; - • 7c t 






, i. • i 

.... v s, A j>-.,s.., 


1992 


Georgia 


206 (2.1) - : 


159(4.4) 


184(4.9) 


210 ( 4.4) 


230:( 5.1) 


249 ( 




Southeast 


207 ( 43) : 


160 ( 6.3) V* 


182 ( 8.1) 


210 ( 4.7) 


231 { 5.2) 


250 ( 4.4) 




Nation 


211 (16) . ; 


. 185 ( 1.6) 


190 { 2.8) 


214 { 2.6) 


234 ( 2.6) 


252(2.8):- 


1994 


Georgia 


199 ( 3.4) :. 


142 ( 8.5) S 


173(1,4) 


202 ( 79) 


230 ( ZB) 


252 ( 3.0) :£ . 




Southeast 


207 ( 39): : 


158 (15.1®: 


:>184 ( 7J2) 


; 210(4.5) 


230 ( 6.5) 


250 ( 8-. : 9}1& 




Nation 


, 206 


f V149 { 3.0) < 


^1;81 : (-26)Vf 


212 ( 0.8) 


: 235 ( 2J4)^, 


255 ( 4.0) 


High school non-graduate 




•|- • ; *-•’ •> ? •' f • 








!. 


1992 


Georgia 


201 (3 9)B* 


: 155 ( 7.9) fM 


180(3.9) 


203 ( 2.8) 


224 ( >3.8) 


244 C ; 5Ll)l:t 




Southeast 


197(3.8) 


155 (8.7) 


175 ( 9.7) 


198 ( 4.4) 


220(6.7) 


235 ( 6.3) : 




Nation 


197(2.7); 


154 ( 5.7) 


175 ( 7.2) 


;199 ( 3.1) 


221 (79) 


•241 (9.|)>f. 


1994 


Georgia 


185(5,4)1 


126 (16.3)C 


159(11.4) , 


>191 (5.6) 


217*(99) 


235 ( 3.6) 




Southeast 


186 ( 46) J 


• 139 (24.0)., 


163 ( 8.9) 


,1186(9.1) - 


212*7.8) 


232 (4:0) &v 




Nation 




r : .:;137(7:3);M| 


|t162;(;8:8).;4 




|^b:(W9),;;,:. 


236 ( 4:3)|g 


1 don't 
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r r .;T 


^ tf - 








• • •' ■ : 


1992 


Georgia 


206( : ll4)S£; 


■'160 ( 1.4) |j| 5 


Ns2 C211) }? 


’207(1:1) 




249 '( Zffj'kl 




Southeast 


205 ( 26) 


180(3.6) iS' 


*185 ( 3.7) 


338(5.4) 


229,(2.4) 


244 ( 4'4)>'!V: 




Nation 


209 (1.3); • 


163(1.9) 'gs 


187(1.8) 


212 ( 1.5) 


232 (1.7) 


251 ( 29) ; 


1994 


Georgia 


199 :*;• 


,142(4.6)1®; 


173 < 4.7) 


2D4 ( 2.7) 


229 ( 3.8) 


250 ( 2 0) v 




Southeast 


200 (29)f ir 


146(4.8):.: 


: 174(2.9) 


;t 333.(4.4) 


’£28 1(125) ; 


247 




Nation 


204.(^6&;- 


SVlSO ( 3.1) 


v 




234 ( 1.6) 


,253.(;4!9fei 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Gender 

In general, NAEP reading assessment results for males and females support 
numerous studies that have revealed gender differences favoring females in reading. 20 
As shown in Table 2.4, the 1994 Trial State Assessment Program results for Georgia 
are consistent with those general findings. 

1994, Public School Students 

In public schools in Georgia, girls exhibited an average reading 
proficiency which was higher than that of boys. 

1992 vs 1994 , Public School Students 
In Georgia public schools, the average reading proficiency for boys was 
lower in 1994 than in 1992. However, the average proficiency for girls 
did not change significantly from 1992 to 1994. 




TABLE 2.4 

Distribution of Reading Proficiency for Fourth-Grade 
Public School Students by Gender 



1994 Trial State Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 




Male 






'CL ’■* \ . - -v 








1992 Georgia 
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pas 
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1994 Georgia 
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.'204 


f 231 (132).*# 
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Nation 


|207< 1S)g| 
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• 211 (i6)f: : 


237(vi;?)|g| 


; : 257 ( 1.9) •; 


Female 




mm / f \ 


11 C <<„"t 1 1 ' 
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| £4 
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1992 Georgia 
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Southeast 






$ 194X3y4)£M 


::2i8(25);: 


238(33) i 


1 258X4.3) iff; 


Nation 


219 


173(2.1) 




221 ( 1.1) : ' 

-•»- ' <■>„ 


243 (1.6): 


262(1.7) 


1994 Georgia 


212 (2.2) ||| 


• 1S8 { 25)1-.."# 186 ( 2.2*t : - ^ 


215(3.4) 1 


242(1.9) 33 


: : 262-( 2.1) 1 


Southeast 


; ;:215(22)R:I> 


11-165 { 2.4) "'i 




217 ( 2.5) 


240 ( 3.5) 
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222 ( 2J) . 


245 ( 


ft264(:2.1)Xr: 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 



Proficiency According to Purpose for Reading 

Table 2.5 provides a summary of results according to each of the two purposes 
for reading by race/ethnicity, type of location, parents’ education level, and gender for 
public school students. 





20 



Ian Plewis. “Pupils’ Progress in Reading and Mathematics During Primary School: Associations with Ethnic Group 
and Sex,” in Educational Researcher,’ 33. (1991). pp. 133-140; Gita Z. Wilder and Kristin Powell, Sex Differences in 
Test Performance: A Survey of the Literature. (New York: College Entrance Examination Board, 1989). 
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TABLE 2.5 

Fourth-Grade Public School Students’ Average 
Reading Proficiency According to Purpose for Reading 
by Subpopulation 





Reading for Literary Experience 


Reading to Gain Information 


1992 


1994 


1992 


1994 








Proficiency 




RA CE/ETHNICfTY 




v .. . .. - T V “ 






; T* •” * 1 'fip 


White 


Georgia 


227 ( 1.5) 
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222(2.1) 




Southeast 
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1 ; 224(1.4) 
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Black 
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201 (2.3) % 


Urb Fringe/Lrg Town 


Georgia 


■ 222:(;2.5)::^tl 


:214-:(?5.0) ' 


Ri|lbS-(24)l|§f! 


! • : ^:;2i^i(A.8)-^ : lll 




Nation 


221(2.1) 


f : 220( 2.0) : 


: : 217(2.4) 


: 217( 2.1) ^ 


Rural/Small Town 


Georgia 


214(2.1) 


205(2.7) 


208(1.7) : 


206 ( 2.8) 




Nation 


220 ( 2.2) - 


216 (2:0) 


214(3.0):: 


210(2.1) .4 


PARENTS’ EDUCATION 




. • * *X |||i^ ij 3, V1 jjf l \ 




r':-- 


College graduate 


Georgia 
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t don’t know 
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v, . 198T2.9) 
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GENDER 




■ ■ . ; ; " •. f? 








Male 


Georgia 


212(1.8) 


200 ( 3.0) < 


337(15) i 


2(^(3.2) 




Southeast 


206 ( 3.1) ; ; 203 ( 2.7) 


='. ,'•203(29) J 
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;; i 2131(4:^ 
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Female 
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218(1.8) 


215(2^) 


^ ;: ti2ii (20) -^ : ; ; 


210(2.4) ■;!# 




Southeast 


219 ( 2.3) 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. 
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Reading Proficiency of Non-Public School Students 

The 1994 Trial State Assessment Program marks the first time that non-public 
school students were assessed at the state level. Therefore, separate non-public school 
results can be reported for Georgia. Also, results based on a combined sample of public 
and non-public school students can be presented. Trend results are not presented for 
non-public school students because they were not included in the 1992 samples. 

Table 2.6 shows the distribution of overall reading proficiency for non-public school 
and combined populations in Georgia, the Southeast region, and the nation. The 
corresponding results for public school students are presented in Table 1.1. 

1994 Non-Public School Students 

The average reading proficiency of fourth-grade students in non-public 
schools in Georgia was 234. This average was not significantly different 
from that of non-public school students across the nation (231). 

Public and Non-Public School Student Comparison 
The average reading proficiency of fourth-grade students in non-public 
schools in Georgia was higher than the average for public school 
students (234 for non-public and 207 for public). For the nation, the 
average reading proficiency for non-public school students was higher 
than that of their public school counterparts (231 for non-public and 212 
for public). 

1994, Public and Non-Public School Students Combined 
The average reading proficiency of grade 4 students from Georgia was 
209. This average was lower than that of students across the nation 
(214). The lowest performing 10 percent of fourth graders from Georgia 
had proficiencies at or below 150 while the top 10 percent had 
proficiencies at or above 261. The lowest performing 10 percent of 
students across the nation had proficiencies at or below 159 while the 
top 10 percent had proficiencies at or above 263. 
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TABLE 2.6 



Distribution of Reading Proficiency for Fourth-Grade 
Students, Non-Public and Combined Schools 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 




The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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Table 2.7 presents proficiency by purpose for reading for both the non-public 
school and combined populations. The corresponding public school student results can 
be found in Table 1.2. 



1994 , Non-Public School Students 

The proficiency of non-public school students in Georgia in reading for 
literary experience (234) was not significantly different from that of 
students across the nation (233). Similarly, in reading to gain 
information, the proficiency of Georgia’s non-public school students 
(234) did not differ significantly from that of students across the nation 
(229). 



1994 , Public and Non-Public School Students Combined 
The proficiency of Georgia students in reading for literary experience 
(209) was lower than that of students across the nation (216). However, 
in reading to gain information, the proficiency of students in Georgia 
(208) did not differ significantly from that of students across the nation 
( 212 ). 
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TABLE 2.7 

Distribution of Reading Proficiency for Fourth-Grade 
Students According to Purpose for Reading, 
Non-Public and Combined Schools 





Average 


10th 


25th 


50th 


75th 


90th 




Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 


Reading for Literary Experience 
1994 Non-Public 

Georgia 
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Nation 
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:.:>239::C32) : 0, 
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257(4.4) 
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; 216|( 
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Reading to Gain Information 
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Georgia 
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Nation 


234 ( 6.4) 
234 ( 6.6) 
229 : ( 2.6)0- 


188 ( 8.7) * 
187(18.1) 
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212(3.6) 

::v207(5-0) =4.- 


233 ( 7.5) 

234 ( 3,9) 
230(3.% : 


257(77) 
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33(2.6) 


• 275 ; C7.3)' ? 
280 ( 8.0) 
273(2,8) 
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Georgia 
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Nation 


208 ( 2.4) : 
207 ( 2.0) 
212 ( 1.0) . 


148(35) 
151(2.8) 
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Ill 


211.(2.4} 
209 ( 2,4}- 
216(1.1) 
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264(25) 

260(22} 

263(1-4) 



The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). 
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PART TWO 



Reading Achievement Levels 

W hile providing information about what students can do in reading is essential 
for understanding the current state of reading performance, it is also important to 
determine whether students’ present performance is adequate. Knowing what students 
can do is made even more relevant by also looking at what students should be able to 
do. For that reason, the National Assessment Governing Board (NAGB) has provided 
NAEP with achievement levels in reading that set standards for performance in reading 
at grades 4, 8, and 12. 

This report presents data using the student achievement levels as authorized by the 
NAEP legislation and adopted by the National Assessment Governing Board 
(NAGB). 21 The achievement levels are based on collective judgments, gathered from 
a broadly representative panel of teachers, education specialists, and members of the 
general public, about what students should know and be able to do relative to a body 
of content reflected in the NAEP assessment frameworks. For reporting purposes, the 
achievement level cut scores are placed on the traditional NAEP scale. For each grade, 
the results divide the scale into four ranges — Basic , Proficient , and Advanced, as well 
as the region below Basic . 

Initiated in 1990, the levels have been used to report the national and state results 
in mathematics in 1990 and 1992, as well as in reading in 1992 and 1994. The reading 
achievement levels were developed by American College Testing (ACT) under contract 
with NAGB. While setting student achievement levels on the National Assessment is 
relatively new and developing, the achievement levels are consistent with recent 
education reform efforts. Some state and local jurisdictions are also developing 
standards and reporting their test results using them. 22 



P.L. 103-382. Improving Ajnerica’s Schools Act of 1994. 

22 States such as Kentucky, Maryland, Colorado, Connecticut, and North Carolina all have standard- setting initiatives 
resulting in student achievement levels. 
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Despite the commitment to standards-based reporting of NAEP data, the transition 
is incomplete. There have been some critical reviews and congressionally mandated 
evaluations that cast doubt on the interpretability of achievement levels and also on the 
applicability of the underlying technical methodology used to develop them. These 
studies were conducted by the General Accounting Office (GAO) 23 and the National 
Academy of Education (NAE). 24 Their findings question, for example, the application 
of the Angoff method for large scale assessments like NAEP, given the significant 
modifications required to accommodate the complexity of the NAEP item structure and 
the multiple cutpoints. They conclude that discretion should be used in making 
particular inferences about what students at each level actually know and can do. In 
addition, there were concerns that the proportion of students at certain levels, but 
particularly at the advanced levels, may be underestimated. 

On the other hand, the Angoff procedure is the most widely documented, 
researched, and frequently used method in the standard-setting field. Many well-known 
experts support the use of a modified-Angoff method on NAEP. Several critics of the 
NAE studies, 25 for example, have reaffirmed the integrity of the process employed by 
the Board and have concluded that the weight of the empirical evidence presented does 
not support the NAE’s conclusions about achievement levels or the use of the 
modified-Angoff process. In addition, the Council of Chief State School Officers’ 
advisory panel of state assessment directors, fully aware of the NAE’s conclusions, 
supported the use of the achievement levels to report the 1994 reading results. 26 

Taken together, the results of the various studies suggest the need for further 
research and development. To that end, ACT, the NAGB contractor, recently conducted 
a study in anticipation of the 1994 NAEP reading reports. The study sought to examine 
the congruence between the reading assessment framework and the descriptions of 
reading performance embodied in the levels. 27 Two different methodologies were used: 
(1) evaluation of the achievement level descriptions via statistical item mapping, and (2) 
evaluation of the achievement level descriptions via judgmental item mapping. It was 
the consensus of the participants that the reading achievement level descriptions were, 
in general, consistent with the framework and the 1994 NAEP reading assessment 
results. However, minor modifications were suggested by the study panelists. These 
modifications were incorporated into the 1994 achievement level descriptions. 




23 

General Accounting Office. Educational Achievement Standards : NAGB' s Approach Yields Misleading 
Interpretations. (Washington, DC, 1993). 

24 

National Academy of Education. Setting Performance Standards for Student Achievement. (Stanford, CA: National 
Academy of Education, 1993). 



American College Testing. Technical Report on Setting Achievement Levels on the 1992 National Assessment of 
Educational Progress in Mathematics, Reading , and Writing. (Washington, DC: National Assessment Governing 
Board, 1993); G. Cizak. Reactions to the National Academy of Education Report. (Washington, DC: National 
Assessment Governing Board, 1993); M. Kane. Comments on the NAE Evaluation of the NAGB Achievement Levels. 
(Washington, DC: National Assessment Governing Board, 1993). 

26 Education Information Advisory Committee of the Council of Chief State School Officers. A Resolution of the 
Education Information Advisory Committee. (Alexandria, VA, 1994). 



27 



American College Testing. 
College Testing, 1995). 



Technical Report on the 1992 NAEP Reading Re-visit Study. (Iowa City, LA: American 



44 



51 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Georgia 



It should be noted that the ACT study did not address the applicability of the 
modified- Angoff procedure for the 1994 reading assessment. Nor did it focus on the 
reasonableness of actual achievement level cut scores. However, NAGB continues to 
explore new and innovative methodologies for standard setting for NAEP. In addition, 
proceedings from a standard-setting conference held in the fall of 1994, jointly sponsored 
by NCES and NAGB, are due to be released in the fall of 1995. Given the array of 
nationally known experts in attendance, the findings will undoubtedly provide additional 
insight into this issue. 

In sum, the student achievement levels in this report have been developed carefully 
and responsibly, and have been subject to refinements and revisions in procedures as 
new technologies have become available. However, standards-based reporting for NAEP 
data is still in transition. The NAEP legislation states that the student achievement levels 
shall be . . developed through a national consensus approach . . . used on a 
developmental basis, . . . and updated as appropriate.” It requires that their 
developmental status be clearly stated in NAEP reports. Upon review of the available 
information, the Commissioner of NCES has judged that the achievement levels are in 
a developmental status. However, the Commissioner and the Governing Board also 
believe that the achievement levels are useful and valuable in reporting on the 
educational achievement of American students. 

Part Two of this report focuses on results of the 1994 Trial State Assessment 
Program in terms of the NAGB achievement levels. Chapter 3 provides an overview 
of the achievement level descriptors. In addition, the percentages of public school 
students in Georgia, the Southeast region, and across the nation who performed at or 
above each of the achievement levels in 1994 and 1992 are presented. Chapter 4 
expands on these results by presenting achievement level data for subgroups — 
race/ethnicity, type of location, level of parents’ education, and gender. Chapter 4 also 
presents results for students in non-public schools and combined results for both public 
and non-public school students. 
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CHAPTER 3 



Students’ Reading Achievement 



The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382), As a result, students’ reading proficiencies presented in the previous 
section can be viewed in the context of established goals for performance. This report 
next presents results based on the National Assessment Governing Board’s goals for 
students’ achievement on the NAEP reading scale. 28 

Achievement goals are determined through collective judgments about how 
students should perform. These judgments are associated with specific points on the 
NAEP scale that serve to identify boundaries between levels of achievement for each 
grade — Basic, Proficient, and Advanced. Performance at the Basic level denotes partial 
mastery of the knowledge and skills that are fundamental for proficient work. The 
central level, called Proficient, represents solid academic performance. Students 
reaching this level demonstrate competency over challenging subject matter. 
Performance at the Advanced level signifies superior performance beyond proficient 
grade-level mastery. In this report, the proportion of students attaining the three 
achievement levels is presented for both the 1994 and 1992 assessments. 

Definitions of the three levels of reading achievement are given in Figure 3.1. 
Examples of questions at the achievement levels are also provided. The reading 
passages that accompany these questions can be found in Appendix B. It should be 
noted that constructed-response questions occur at all levels of reading achievement. 



Appendix C briefly describes the process of gathering expert judgments about Basic, Proficient, and Advanced 
performance — as defined by NAGB policy — on each reading item, combining the various judgments on the various 
items and mapping them onto the scale, and setting the scale score outpoints for reporting purposes based on these 
levels. 
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FIGURE 3.1 

Levels of Reading Achievement at Grade 4 



The following achievement level descriptions focus on the interaction of the 
reader, the text, and the context. They provide some specific examples of reading 
behaviors that should be familiar to most readers of this document. The specific 
examples are not inclusive; their purpose is to help clarify and differentiate what readers 
performing at each achievement level should be able to do. While a number of other 
reading achievement indicators exist at every level, space and efficiency preclude an 
exhaustive listing. The achievement levels are cumulative from Basic to Proficient to 
Advanced. One level builds on the previous levels such that knowledge at the Proficient 
level presumes mastery of the Basic level, and knowledge at the Advanced level 
presumes mastery of both the Basic and Proficient levels. 





Fourth-grade students performing at the Basic level should demonstrate an 
understanding of the overall meaning of what they read. When reading texts 




appropriate for fourth graders, they should be able to make relatively obvious 


• vjw**’ .' , '%%% ‘"a , r 


connections between the text and their own experiences and extend the ideas in 


v J i; 


the text by making simple inferences . 



For example, when reading literary text, Basic- level students should be able to tell what the story is generally 
about — providing details to support their understanding — and be able to connect aspects of the stories to their own 
experiences. 

When reading informational text, Basic-level fourth graders should be able to tell what the selection is generally 
about or identify the purpose for reading it; provide details to support their understanding; and connect ideas from the text 
to their background knowledge and experiences. 





Fourth-grade students performing at the Proficient level should be able to 


PROFICIENT 


demonstrate an overall understanding of the text, providing inferential as well as 




literal information. When reading text appropriate to fourth grade, they should be 


£ l 5 :; i 1 


able to extend the ideas in the text by making inferences, drawing conclusions, and 




making connections to their own experiences. The connection between the text 




and what the student infers should be clear. 



Specifically, when reading literary text. Proficient-level fourth graders should be able to summarize the story, 
draw conclusions about the characters or plot, and recognize relationships such as cause and effect. 

When reading informational text, Proficient-level students should be able to summarize the information and 
identify the author’s intent or purpose. They should be able to draw reasonable conclusions from the text, recognize 
relationships such as cause and effect or similarities and differences, and identify the meaning of the selection’s key 
concepts. 






Fourth-grade students performing at the Advanced level should be able to 
generalize about topics in the reading selection and demonstrate an awareness of 
how authors compose and use literary devices. When reading text appropriate to 
fourth grade, they should be able to judge texts critically and, in general, give 
thorough answers that indicate careful thought. 



Specifically, when reading literary text, Advanced-level students should be able to make generalizations about 
the point of the story and extend its meaning by integrating personal and other reading experiences with the ideas 
suggested by the text They should be able to identify literary devices such as figurative language. 

When reading informational text, Advanced- level fourth graders should be able to explain the author’s intent 
by using supporting material from the text. They should be able to make critical judgments of the text (including its form 
and content) and explain their judgments clearly. 
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FIGURE 3.1 (continued) 



Levels of Reading Achievement at Grade 4 



The following questions were selected as examples of the types of questions that 
students at each of the three achievement levels can respond to effectively. The example 
questions were selected from the 1992 or 1994 NAEP reading assessments. These 
questions are based on the stories “Sybil Sounds the Alarm” and “Hungry Spider and 
the Turtle,” which are shown in their entirety in Appendix B. “Sybil Sounds the Alarm” 
is a fictional account of a historical event that describes the courage of a young colonial 
girl in riding her horse to warn of the approaching British army. “Hungry Spider and 
the Turtle” is a fable that presents a humorous portrayal of two characters and the jokes 
they play on each other. Both stories were used to assess reading for literary experience. 

For the multiple-choice questions, the correct answer is marked with an asterisk. 
For the constructed-response questions, a description of acceptable answers is provided. 
Also shown are the national overall percent correct and the percent correct for the 
students performing within the interval of the indicated level. For example, students 
with an average reading proficiency in the range 208-237 are in the Basic interval : at 
or above the cutpoint for the Basic level and below the cutpoint for the Proficient level. 

Samples of student responses to these and other constructed-response questions in 
the NAEP reading assessment appear in the Reading Assessment Redesigned 29 report 
which provides an in-depth look at the assessment materials and tasks. Also, a 
presentation of sample student responses can be found in the 1994 NAEP Reading Report 
Card. 



BASIC LEVEL 
Example Question^ r •, ^ 


Sybil Sounds the Alarm 


Sybil’s father thought that she 

A. was obedient but forgetful 
* B. was courageous and a good rider 

C. could lead the troops against the British 

D. could easily become angry 


1992 Overall Percentage Correct 


’5 ; 1992 Conditional Percentage; Correct 
for Basic Interval 


Nation 


71 (1.4) 


Nation 


75 (2.4) 



29 J.A. Langer, J.R. Campbell, S.B. Neuman, I.V.S. Mullis, H.R. Persky, and P.L. Donahue. 
Redesigned. (Washington, DC: National Center for Education Statistics, 1995). 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



Hungry Spider and the Turtle 



Who do you think would make a better friend, 
Spider or Turtle? Explain why. 



Acceptable responses indicated which character would make a better friend 
and provided appropriate evidence from the story in support of the 
selection. 



1994 Overall Percentage Acceptable 


1994 Conditional Percentage Acceptable^ 
: i|pT;Basic Interval ||p, < $ 


Nation 


62 (1.4) 


Nation 


68 (2.3) 



BASIC LEVEL 

Example Question 



PROFICIEl 


NOT EEVEL ii|ir 

®s^sa^3l : p 


Sybil Sounds the Alarm 


The information about the statue and stamp helps 
to show that 




* A. people today recognize and respect Sybil’s bravery 

B. people were surprised that George Washington honored her 

C. the author included minor details 

D. heroes are honored more now than they were then 


;fK.<||i992 -Overall Percentage -Correct:; 

pjjjj 


V,i:1992 Conditional Percentage .Correc|fcgj 
for Proficient Interval 


Nation 


62 (1.5) 


Nation 


87 (3.4) 
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FIGURE 3.1 (continued) 

Levels of Reading Achievement at Grade 4 



PROFICIENT LEVEL 

Example Question 



Hungry Spider and the Turtle 



What do Turtle’s actions at Spider’s house tell 
you about Turtle? 



Acceptable responses provided a description of Turtle that is consistent 
with the traits portrayed by the character in a specific part of the story. 



1994 Overall Percentage Acceptable 


1994 Conditional Percentage Acceptable 
§ §Sjj for Proficient Interval 


Nation 


41 (1.4) 


Nation 


64 (3.0) 



Sybil Sounds the Alarm 



How does the author show the excitement and 
danger of Sybil’s ride? 



Acceptable responses described a specific element of the author’s portrayal 
of Sybil that contributed to the story’s atmosphere and tone. 



•? t "■ i : s; -Jf , : : -x- {,«• j«. : > 

"w i Z ' 1 V ^ '•/ •; 

1992 Overall Percentage Acceptable 


mmmm 


rcentage Acce 
ed Interval £ 

i '>; v . 


iptable 


Nation 


44 (1.7) 


Nation 


83 (4.9) 
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FIGURE 3.1 (continued) 



Levels of Reading Achievement at Grade 4 









ADVANCED LEVEL 




Hungry Spider and the Turtle 



Think about Spider and Turtle in the story. 
Pick someone you know, have read about, 
or have seen in the movies or on television 
and explain how that person is like either 
Spider or Turtle. 



Responses that were rated as Essential or better demonstrated adequate 
understanding of the character of Spider or Turtle by providing any 
story-supported character trait and relating or linking that trait to a real 
world person or character. 



1994 Overall Percentage Essential 


j! 

or Better fo 


tal Percentage 1 
r Advanced ilnt 


Essentia] 

erval 


Nation 


29 (1.3) 


Nation 


73 (8.6) 



O 
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Table 3.1 provides the percentage of fourth-grade public school students at or 
above each achievement level, as well as the percentage of students below the Basic 
level. 



1994, Public School Students 

The percentage of public school students in Georgia who were at or 
above the Proficient level (26 percent) did not differ significantly from 
that of students across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Georgia who attained the Proficient level 
(25 percent in 1992 and 26 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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TABLE 3.1 

Levels of Fourth-Grade Public School Students 9 
Reading Achievement 



1994 Trial State Assessment 


At or Above 
Advanced 


At or Above At or Above 

Proficient Basic 


Below 

Basic 




Percentage 


1992 Public 

Georgia 
Southeast 
Nation 
1994 Public 
Georgia 
Southeast 
Nation 


• 5 ( 0.8). : 25(1.5) , 57 ; (1.7) ‘ 43(1.7) 

4 (0.8) ' -ii' i/I : 22 (2.6) 55(3.5) ' *45(-3.5) 

•* ... : 6(0.8) , ,27(1.3) ^ ^ VjBO-f 1:1) , . : vff.|5W(,1:.1) 

r . 7(1.0) 26(2.0) Vi"' ’-52(2.3) . f 48(2.3) 

T '.'6 ( 0.6) (2.1). (:2.4) . . C> i' if { 2.4) 

r.7 : ('tf.7)£:rt^S5#';.28( i2) ( i.i) ' ) • ' r 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Many students in Georgia were unable to meet the Proficient achievement level 
that represents solid academic performance in reading. Educators and policy makers 
will need to look to many sources of information and opinion for explanations of these 
levels of achievement. Among the possible explanations, several factors should not be 
overlooked. First, students may not be learning enough in school to reach the 
achievement levels. In 1983, the National Commission on Excellence in Education 
warned that “the educational foundations of our society are being eroded by a rising tide 
of mediocrity that threatens our very future.” 30 In 1990, the president and the governors 
committed the nation to six goals for education, the third of which called for American 
students to “leave grades four, eight and twelve having demonstrated competency in 
challenging subject matter.” 31 Many political leaders of this nation continue to express 
dissatisfaction with the performance of American students. These NAEP findings 
confirm that a great many American students are not yet performing at high levels. 

Second, some students may not be reaching the higher achievement levels because 
schools may not be teaching the elements of reading that are included on the NAEP 
assessment, and because the assessment may not be covering some elements of reading 
included in the school curriculum. No assessment or test can cover all the different areas 
of reading that are taught in school. The content coverage of the NAEP reading 
assessment was set by a consensus approach. Teachers, curriculum specialists, subject 
matter specialists, local school administrators, parents, and members of the general 
public actively participated in deciding what are the most important elements of reading 
to be included in the assessment and for students to learn. 32 

Third, the Basic, Proficient, and Advanced achievement levels reflect high 
standards for the 1994 NAEP reading scale. The establishment of achievement levels 
depends on securing a set of informed judgments of expectations for student educational 
achievement and on summarizing the individual ratings into collective judgments. These 
expectations reflect the Board’s policy definitions, which require that students at the 
central, Proficient level demonstrate “competency over challenging subject matter.” The 
resulting standards are rigorous. 

As measures of performance, both average proficiency scores and percentages of 
students who score at or above the critical achievement levels on the NAEP scale 
provide a valuable overall depiction of students’ reading ability. 



0 National Commission on Excellence in Education. A Nation at Risk. (Washington, DC: U.S. Department of 
Education, 1983). In 1988, then-Secretary Bennett reported that the “precipitous downward slide of previous decades 
has been arrested, and we have begun the long climb back to reasonable standards.” (p. 1 in American Education: 
Making it Work . (Washington, DC: U.S. Department of Education, 1988).). 

31 U.S. Department of Education. America 2000: An Education Strategy. (Washington, DC: U.S. Department of 
Education, 1991). 



32 NAEP Reading Consensus Project. Reading Framework for the 1992 and 1994 National Assessment of Educational 
Progress. (Washington, DC: National Assessment Governing Board, U.S. Department of Education, 1994). 
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CHAPTER 4 



Reading Achievement of Fourth-Grade 
Students by Subpopulations 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 33 This chapter presents achievement level results for subgroups of public 
school students from Georgia defined by race/ethnicity, type of location, level of parents’ 
education, and gender. Also, results are presented for non-public school students and 
for the combined public and non-public school populations. 

Race/Ethnicity 

Table 4.1 provides the percentage of public school students at or above each of 
the three achievement levels and also the percentage below the Basic level for White, 
Black, and Hispanic students. 

1994, Public School Students 

In 1994, the percentage of White students in Georgia who attained the 
Proficient level was greater than that of Black and Hispanic students. 

1992 vs 1994, Public School Students 
There was no significant change between 1992 and 1994 in the 
percentage of White, Black, and Hispanic public school students in 
Georgia who performed at or above the Proficient level. 



61 



33 Ina V.S. Mullis, John A. Dossey, Jay R. Campbell, Claudia A. Gentile, Christine O’Sullivan, and Andrew S. Latham. 
NAEP 1992 Trends in Academic Progress. (Washington, DC: National Center for Education Statistics, 1994). 
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TABLE 4.1 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Race/Ethnicity 



1994 Trial Stale Assessment 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 






Percentage 




White 










1992 Georgia 


: 3(1-2) 


34 ( 1.9) 


71 (1.6) 


29(1.6) 


Southeast 


6(1.1) 


29(3.9) 


67(4.8) 


33(4.8) 


Nation 


8(1.0} : 




70 ( 1.5) 


; / 30(iJ5)£S;g 


1994 Georgia 


TO ( 1.5) 


36(2.4) 


67(2.0) 


33 ( 2.0) 


Southeast 


8 ( 0.8} 


illlipt ( 2.9) •§ jfe j 


65 ( 2.2) 


35 ( 22) 


Nation 


9 ( 0.9} 


ISliiSSis)/ 


69(1.3) 


31(1.3) 


Black 










1 992 Georgia 


1 ( 0.6) 


■MBISIj) ; 


36(2.7) 


64(2.7) 


Southeast 


1 ( 0.9) 


9 ( 22) 


34(3.9) 


66(3.9) 


Nation 


yWQ-Sb: iy 


: 3(1.4) 


ffjgj • ; 


68(2.1) 


1994 Georgia 


( 0.5) : 0 


10 ( 2.0) 


30(3.2} 


70 ( 32) 


Southeast 


1 (0.6) 




32(4.3) 


68 ( 4.3) 


Nation 


, / -'I (04) 


|j ;'8 ( 0,9) 


30(2.5) 


70 ( 2.5) 


Hispanic 










1992 Georgia 


2(1.8) 


IfSH 15(3.6) ' i 


34 ( 5.8} 


66 ( 5.8) 


Southeast 


T ( 0.6)1 


i£(23)i : • 


39 ( 4.9)1 


61 ( 4 .9)1 


Nation 




14(1.8) 


|g|j 


58(2.1) 


1 994 Georgia 




j 'r:! 


36(4.8} 


64 < 4.8) 


Southeast 


1(1.6) 


C' 'j 


'26 (4,3):;' 


74(4.3) 


Nation 


2(0.7) 


12(1.6) 


33(26) 


67 ( 2.6) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1 994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 
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Type of Location 

Table 4.2 presents reading performance by achievement levels for fourth-grade 
students attending public schools in central cities, urban fringe/large towns, and rural 
areas/small towns. 



199 4 y Public School Students 

In Georgia, the percentage of students attending public schools in central 
cities who attained the Proficient level was not significantly different 
from that of students in urban fringe/large towns or rural areas/small 
towns. 



1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of students attending public schools in central cities, urban fringe/large 
towns, or rural areas/small towns in Georgia who attained the Proficient 
level. 
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TABLE 4.2 

Levels of Fourth-Grade Public School Students 9 
Reading Achievement by Type of Location 



1994 Trial State Assessment 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 






Percentage 


Central City 


Iplpl iB llpllllii 




% - v ' if'?* 




1992 Georgia 






45(4.6) 


55 { 4.6) 


Nation 


■ 4(0.7) 


20 ( 1.4) 


51 (2.0) 


i^iili ; 2.o). i gz 


1 994 Georgia 


iiiitiliift) ' 


19 ( 4.3)" 


ftlllpliillT)' ■■ ! 

: 50 (2,7} 


59 ( : 5i||lfip 


Nation 




22 ( 2.0) 


50 (.2.7) ; : 


Urban Fringe/Large Town 








V ' ! I 


1992 Georgia 




31 ( 2.8) : - 


65(2.6) 


i? iV/f =35 £2.6)' > ' \ 


Nation 




V' 31(2.6), 


. ; /; ;; 


.36 (2JS$ Cf# 


1 994 Georgia 


jilt 9 cli&IS 


; : 1 31 ( 3.5) ' '' 


59 ( 4.3) 


/ : 41 ( 4.3) 


Nation 


: ' > 


33(2.0) 




'35 {1.3) . 


Rural/Small Town 




3 v 


: ' • saiiii® 


y J ^ >> A' 


1992 Georgia 




23 ( 2.0) 




Nation 








;/,± 36(2.5) 


1 994 Georgia 


i-o> 


• : 22(2.9K'P#S 


Sp®50 (3:by / - ■ 


!®SV50C3;b) 


Nation 


ISSI 


* 27(2.0)i 


59 ^ 


'41 (2.6) 'j <3 



School sample size is insufficient to permit reliable regional results for type of location. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Parents’ Education Level 

Table 4.3 shows the reading achievement level results for fourth-grade public 
school students who reported that at least one parent graduated from college, at least 
one parent had some education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know their parents’ 
education level. 



1994, Public School Students 

In Georgia, the percentage of students reporting that at least one parent 
graduated from college who performed at or above the Proficient level 
was not significantly different from that of students who reported that 
at least one parent had some education after high school but was larger 
than that of students who reported that at least one parent graduated 
from high school, neither parent graduated from high school, or they did 
not know their parents’ education level. 

1992 vs 1994, Public School Students 
The percentage of public school students in Georgia who reported that 
at least one parent graduated from college, at least one parent had some 
education after high school, at least one parent graduated from high 
school, neither parent graduated from high school, or they did not know 
their parents’ education level who attained the Proficient level did not 
change significantly between 1992 and 1994. 
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TABLE 4.3 

Levels of F ourth-Grade Public School Students ’ 
Reading Achievement by Parents’ Level of Education 



1994 Trial State Assessment 


At or Above 






At or Above 


At or Above 






Below 




Advanced 






Proficient 


Basic 






Basic 










Percentage 








College graduate 


S* JV '/ ’* k , . 




lvV‘ 


i JJ jf! i. • ■ 3?; 




; ■{:% 


. : • 


till 


1992 Georgia 


} : 8 (1.6) 








• • (:2v4) ? “ • 






33 ( 2.4) 


Southeast 


~ 8 ( 1.2): 






311(38) : ^ * 


’ a 83 ( 3.4) . : 




v 4 : 1 


: 37 ( 3.4) Ui::: 


Nation 






111 . 


: 36(2^) |J; ?; 


68 (1.9) ; 


; ri 


I2.il 


32|l-5) |||: 


1994 Georgia 






1? 




• '* : C«1 ('afe'T* 




■ *| f : ' 


39 ( 3.0) W? 


Southeast 


9(1.3) 




... 


3*:(28) r 


U 60 (3.7} 






40 (;3.7) lS-< 


Nation 






It 


37( 1 .9) '|f. ; 


a 68 (-15),,,: 






32(:15) lUt 


Some education after HS 












= . : - 


. ■ . • 


1992 Georgia 


8 ( 310) : 




'y ■ 


’ : 3J3?:(ii)* ' 


, : ' vf ei (4,0) 








Southeast 


6(3,3) 






28 (5.0) r 


-..ft 61 ( 7i) 




r'H 


39( 7.1) g.:. 


Nation 








‘ ;.4fg|3v6) ; 






III:: 


32 ( 3.3) 


1994 Georgia 


" 9 (£i)\ : 




%y 




''ll : 62( 4.5}- 


: • 


38 ( 4.5) 5r ' 


Southeast 






% 


36(3.7) 


• ^ 4 68 ( 5.5) 






32(5.5). ||f"; 


Nation 








• ;:3&;(22) 


•.^h58( ; 32}U 




32 ( 32) ' • 


High school graduate 














IfS 




1992 Georgia 


"* 3oi4fr- 






18 (25) -S’ : 


: ( 33) •- 




1 'fj * < 


47 ( 3,3) 


Southeast 


. i;; 2 ( i.6) ; ; .. 






. 18 ( 42) ij:.:. 


’ \££S3 ( 4.5) : • 






47 ( 45) . i : i t .I 


Nation 






ife 


; j?1(,2 r 3) ; *|}g. 


5612|}|j. 




:|4| 




1994 Georgia 




rf? 


•I;- 


t48(25) ^f?f 


::|p44 ( 311) ^ ' : 






'56{3.1)"'l!Sri 


Southeast 


.■t 4 (1.5} 






1^(42) 


. " |.52 ( 4.9) 






48(48) 


Nation 








22 ( 2.7) ; 


;^;-54 ( SL2};,- 




Ifil'v 


.46(22) ;|||C 


High school non-graduate 




f* 




• : -• ::; -t ’ • r 


^ ‘ v : * ’ •*: V:| ' 




» ■ 


1^.' * 


1992 Georgia 


' P: afSfriv 






;;13r| ; 3.i) 


" lfl; : 43 (5.5) 




i4! : " 


57 ( 55) 0ft r : 


Southeast 


!•: Q:( 0J6) : 


; ;. 


33 




Jf|1,39( 8.6). 




lit; • 


&im M • 


Nation 






pi 


• -11.(2^) . j 


-38(3.9):; ; 


s» 


62(38) j;|U 


1994 Georgia 








"8(2.3) ffr : 


7 




II 'll 


-66(4.6) 


Southeast 








71(25) | v 


J|28(5.3) 




1 


72 (5.3) '.JSL::, 


Nation 

1 don’t know 


ir; 






^2>4) 






68 (4. 1 ); ' ^ 


1992 Georgia 


■ ‘ 3 {6&y- 






i8 ( i.7) r|,- r 


” "t?49(i,9) . 




V |'~: 


51(1.9) 


Southeast 


■ 3: 2 ( 0i9) : : 






15(:28) ^1:?: 


•"fi'50 ( 4.9) , .. 




v||^' 


50 (48) Sv: 


Nation 






Hi 




1; 54(1,7) l 




46(1.7) 


1994 Georgia 


(0&) • 




33 


’181(22) . 


• '' : i]£46(2,8)-- 


; ^ 




■54l28)' :; W-' : 


Southeast 


. . 3(i^ 






161(2.3) , 


,'^M5 ( 3.6) 






55(3.6) 


Nation 






| If* 


< §2pp.7)ai^4 











The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Gender 

Table 4.4 provides the achievement level results by gender for fourth-grade public 
school students. 



1994, Public School Students 

The percentage of males in Georgia public schools who attained the 
Proficient level was not significantly different from that of females. 

1992 vs 1994, Public School Students 
There was no significant change in the percentage of males who 
performed at or above the Proficient level from 1992 to 1994. Similarly, 
there was no significant change in the percentage of females who were 
at or above the Proficient level from 1992 to 1994. 
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TABLE 4.4 

Levels of Fourth-Grade Public School Students’ 
Reading Achievement by Gender 



At or Above 
Advanced 



At or Above 
Proficient 



At or Above 
Basic 



Below 

Basic 



Male 



Female 



Percentage 



Georgia 






Wmtsyi 




54 ( 2.2) 






• 46 ( 22) :■ 1 


Southeast 




$ i 






114 






52(4.0) iifli. 


Nation 


5(0.7) 






ili&lISll! 








44 ( 1 .7)® | 


Georgia 








i'\ • /sfi 


BSttSSfl 


' j§g| 




53 ( : 27> |f |ff 


Southeast 






•20(2.3): 


:0m:m 


11146 (i2:8)| 


1 1 § Y . ;l| ii 


ill. 




Nation 


/|g§/ 6(0.8) 


mHmWM 




lill! 


53 ( 1.5) 


V' ; * 


n 


47 ( 1.5) 


Georgia 


fpii 


ffs imgm 


27 ( 1.9) 


Pit.!'; 


60f2*lfl 


:/n; : |i 




40 


Southeast 










gi62 


L/ 






Nation 


°- 9 > 


ww* 


30 (15) 






JSy;T=V 


SP 


35(1.5)/' 


Georgia 

Southeast 

Nation 


m 

8 ('0.9} 


* 1 SmM&f 


28(2.4) 

; 

6)1 


mrn^m 


;:57.'( 2.-5) : 
1159 ;( 3:0) 
!!!64!(!4!3) 


? ' ”111 1 
I i 


93. 

mm 


W: 

$§(! ao) liifp;. 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Reading Achievement of Non-Public School Students 

Table 4.5 provides the percentage of fourth-grade students at or above each 
achievement level for the non-public school and combined populations. Trend results 
are not presented for non-public school students because they were not included in the 
1992 samples. 



1994 , Non-Public School Students 

The percentage of non-public school students in Georgia who were at 
or above the Proficient level (48 percent) did not differ significantly 
from that of students across the nation (43 percent). 

Public and Non-Public School Student Comparison 
The percentage of non-public school students in Georgia who were at 
or above the Proficient level (48 percent) was higher than that of public 
school students (26 percent). For the nation, the percentage of 
non-public school students who attained the Proficient level 
(43 percent) was higher than that of their public school counterparts 
(28 percent). 

1994 , Public and Non-Public School Students Combined 
The percentage of students in Georgia who were at or above the 
Proficient level (27 percent) did not differ significantly from that of 
students across the nation (30 percent). 
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TABLE 4.5 

Levels of Fourth-Grade Students’ Reading 
Achievement, Non-Public and Combined Schools 



1994 Trial State Assessment 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 


1994 Non-Public 




Percentage 




Georgia 




:.r 


5 


■: ;i;...20 (6.2) ,7.r 


Southeast 




7 48 ( 6.3) i T 


82 ( 5.1): 


1 0(5.1) Ifi 


Nation 






, &• 


, . 23 (2.4) . ; $ 


1994 Combined 






' . '7 7 fv * ' •" 


■■■>$"■ ■ . y* 


Georgia 




A 


' A- 


A ;4£i2$ 


Southeast 


7 K o.9>; i * : 




• "7 .$s( 24 f A? 


• 45 ( 2.3)- 


Nation 


7<0.7)i; 


, ; i * 30(1.1) 


,7 60(1.0) 


40(1.0) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample, in 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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PART THREE 



Finding a Context for Understanding 
Students’ Reading Proficiency in Public 
Schools 



Information on the reading proficiency of students in Georgia can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment Program, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on instruction, 
programs, and policies. The student, teacher, and school data help to describe some of 
the current practices in reading education, to illuminate some of the factors that appear 
to be related to fourth-grade public school students’ reading proficiency, and to provide 
an educational context for understanding information on student achievement. 

It is important to note that the NAEP data cannot establish cause-and-effect links 
between various contextual factors and students’ reading proficiency. However, the 
results do provide information about important relationships between the contextual 
factors and proficiency. Through the questionnaires administered to students, teachers, 
and principals, NAEP is able to provide a broad picture of educational practices 
prevalent in American schools and classrooms. 
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In order to improve and refine the NAEP questionnaires, some questions are 
revised and/or reformatted between assessments. Although this allows for more precise 
and relevant data collection, it makes the reporting of trend results on those particular 
questions at best difficult to interpret and at worst, impossible to accomplish. Some of 
the questions reported on in Chapters 5 through 7 were revised and/or reformatted for 
the 1994 assessment. In some cases the revisions, though relatively minor, were of 
sufficient magnitude to make comparisons with 1992 results difficult to interpret. For 
these questions, the results for both 1992 and 1994 are reported; however, no statistical 
comparisons were made, and changes from 1992 to 1994 are not discussed. Questions 
thus affected are indicated in the tables and the reader is cautioned to keep these question 
changes in mind when comparing 1992 and 1994 results. For other questions, 
substantial revisions make comparison to 1992 results unwise or impossible. For these 
questions, no 1992 data are reported. 

Part Three consists of four chapters. Chapter 5 discusses policies and practices 
related to reading. Chapter 6 focuses on instructional approaches — how instruction is 
delivered. Chapter 7 provides information about teachers, and Chapter 8 examines 
students’ home support for literacy. 
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CHAPTER 5 



Policies and Practices Related to Reading 

This chapter focuses on curricular and instructional content issues in Georgia 
public schools and their relationship to students’ reading proficiency. Table 5.1 
provides a profile of the reading policies and practices in the public schools with fourth 
grades in Georgia. Some of the selected results obtained from teacher and school 
questionnaires reveal: 

• According to the public school administrators in Georgia in 1994, 

89 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was not 
significantly different from that of students across the country 
(85 percent). 

• In 1994, according to their reading teachers, 34 percent of the students 
in public schools in Georgia were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
lower across the nation (22 percent). 
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TABLE 5.1 

Reading Policies and Practices in Fourth-Grade Public 
Schools 



1994 Trial Stale Assessment 


Georgia 


Southeast 


Nation 


Percentage of students in public schools that identified 


-|r;/ 


Percentage 


' 4j 


reading as a priority in schoolwide goals and objectives, 






■ 


instruction, workshops, etc.* 








1992 




• :'^88{4,9)^^i 


: ; 4|i 


1994 


8) 


\ >89( 4.3) Jg 


85 { 2.7) . 


Percentage of students in public schools who are assigned 


jj ; ; r fy : 


.. r- ; 


/ ' - .j>K |1 


to a reading class by their ability* 


.-4!S 


• •: * i • v ^ S.pKj 




1992 


'Mf40{-3;8) : ‘M 


: . ! |32 (.5J2) I Mr 


34(4.1) 


1994 


(3.5) 4 > 


(;4.4)H^| 




Percentage of students in public schools who stay with the 




' V'/ • iS 


• tp/ ? • 


same teacher for all academic subjects 


•• . . .&% If i . 


V.: h' ; - - ‘ * 


' ;W : • . iSS vll 


1992 


49 ( 5.4) 


42(4.8) 


48(3.6) 


1994 


;.V>54(5.0) 5|| 


59 { 8:3) /" 


: |i|5T(4|) 


Percentage of students in public schools who remain with 






Mri '' ^ ' t >■ ' 


one teacher for most subjects but may have a different 


, Jll v x r ' 


?>&!■*!;' vv j' 




teacher for one or two subjects 


s-vS&i* "‘iM.L 


. IS. & ; tM 


: S&t-’s ' P 


1992 




~S*46<6^K'' ; 


42(3.9) , 


1994 




; Mt26 <$&:- ;:f#t 


: ’§ 


Percentage of students in public schools in which a reading 






v < 1: y « £ =$?:• 


curriculum specialist is available to help or advise 




57 ( 6.3) 




1992 


. 83X2:6) , M 


67 (2.9) 


1994 


3|f|82,( zap#** 


64(6.1)^4 } 


Percentage of students in public schools that use parents 






as aides in classrooms 


■ IS 






1992 






89 ( 2.6) 


1994 


;;Jj|a2T3;7f ‘4|| 


;i||^2(4.0) 


. ;'#;88 ( 2.3) B 



* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Time for Instructional Activities 

To begin to place students’ reading proficiency in context, it is useful to examine 
the extent to which fourth-grade students’ reading teachers in Georgia are spending their 
time on instructional activities. Teachers of the assessed students were asked to report 
on the amount of time they spent with each class for reading instruction on a typical day. 
Table 5.2 shows the results for public school students. 34 

• In 1994, the percentage of students in Georgia who had reading teachers 
who spent 60 minutes providing reading instruction each day 
(46 percent) did not differ significantly ffom that across the nation 
(44 percent). 

• In Georgia in 1994, average reading proficiency was similar for students 
regardless of how much time their reading teachers spent on reading 
instruction on a typical day. 
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TABLE 5.2 

Public School Teachers 9 Reports on Time Spent 
Teaching Reading 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 




About how much time do you spend for 


Percentage and Proficiency 


reading instruction on a typical day?* 








45 minutes or less 


% -^11* 




1 • $ *» 4 s * 


1992 


fl 

214^3 21 


: \5" 213 "1 40V 


'* • ' 216 ; '( : 2J2) ' 4 * 


1994 


: W,>Ci>y > V;, . , 








t 203 (3.4)'^ 


: |r^209 ( as)- f-f i 




60 minutes 






■rfW ■ i-4' -p & |f 4 -4 


1992 


* i47 (. 3.3) $ -X- x 




1)1! H 




• > . : 2&0 






1994 


* '746:(3:o)i'|i 


t!f 34 ( 5.8) ' M 


M 




* 208 f 2J>Vf Z ’ * 


■ '214f 2.6}:^' ’f*1 


, . - v - ' V 

'■ 217 ( ■1 : %V Ss “ ■' 








. ^ , i 


90 minutes or more 


t ■ £ % 


: fc'r M 


, r i J <***;!; £ s .. . 


1992 


• : f t 


’■h- 20(3.9) M 


, V 




l 213 1 1 


* ; 


• 213 ( 2,5) . ; 4 


1994 




t •’ ;i9:*U-3) : 


49(1^9) : ' x ' j 




208 (fS# j * 


198 { 4.8)1 fj 


200 ( 4.0); : VJ 











* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 



34 t ^ 

For every table in the body of the report that includes estimates of average proficiency, the Data Appendix provides 
a corresponding table presenting the results for the four subpopulations — race/ethnicity, type of location, parents’ 
education level, and gender — as well as by school type. 
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Instructional Resources for Reading 



Teachers’ use of resources is obviously constrained by the availability of those 
resources. Thus, the assessed students’ teachers were asked about the extent to which 
they were able to obtain all of the instructional materials and other resources they 
needed. From Table 5.3: 

• In 1994, the percentage of fourth-grade students in public schools in 
Georgia who were being taught by teachers who reported getting all of 
the resources they needed (19 percent) was larger than the 
corresponding percentage of students across the nation (9 percent). 

• Furthermore, in 1994, the percentage of public school students in 
Georgia whose teachers got only some or none of the resources they 
needed (24 percent) was smaller than that of students across the nation 
(35 percent). 

• In 1994, public school students in Georgia whose teachers got all of the 
resources they needed had an average reading proficiency (216) which 
was higher than that of students whose teachers got only some or none 
of the resources they needed (204). 

• From 1992 to 1994, there was an increase in the percentage of students 
in Georgia whose teachers reported getting all of the resources they 
needed. There was a decrease in the percentage of students whose 
teachers got only some or none of the resources they needed during this 
same time. 
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TABLE 5.3 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Tnal State Assessment 


Georgia 


Southeast 


Nation 




Which of the following statements is true 








about how well your school system 


Percentage and Proficiency 


provides you with the instructional 








materials and other resources you need 








to teach your class? 




~*£!T * 




1 get all the resources 1 need. 




•• • ■ f' ; i '.'$>& H 


ijt a . £■ 41 


1992 


' 10(1.5) 


■‘f.; 1C(22) 






^ 'T'\ 


0%lSif{6.6) 


f 220 (lil)l^- 


1994 


* '■ :: 


• fix 10 . ( 2.4) 


(£.7)10 i 




■ 216(4.6) 


;; 227 ( 2 .i)i 


225 (3.7) | : 


1 get most of the resources 1 need. 


ft ’ '- % f ' V P ' 


. -• YfV &fc •• 




1992 


0 v -056.( 3.0) v 


■ • 45(52) ,5, 


si ( 2.9) : i 










1994 


£^^58^2#- ^ 








207^( 3.1) ; 0 


. ( 3.1) - 


215(1.6) : • ; 


1 get some or none of the resources 1 need. 


rVf ’ 


i" 




1992 






i..:* 39 ( 3,5); ; 4 




; '?iio (2.6) 


4f.21&.( 22) 




1994 










0 


^028* (&3) f| v: 





The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
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CHAPTER 6 



How Is Reading Instruction Delivered? 

Effective classroom instruction can help students become thoughtful readers. 35 
The instructional activities that students complete can also lead them to view reading in 
particular ways 36 and to focus their efforts on developing certain skills and strategies. 
To provide information about how instruction is delivered in Georgia, fourth-grade 
students participating in the Trial State Assessment Program and their reading teachers 
were asked to report on the use of various teaching and learning activities in their 
reading classrooms. 

Instructional Materials for Reading 

Basal reading programs are a traditional part of reading instruction in this country. 
They typically include a compilation of reading passages and exercises, as well as 
ancillary materials, such as workbooks and tests. These types of programs account for 
at least two-thirds of all expenditures for reading instruction and are used in more than 
95 percent of all school districts through grade 6. 37 However, other types of reading 
programs may utilize trade books, such as story or informational books, that are not 
necessarily published for the sole purpose of reading instruction. When students 
encounter a variety of texts, they expand their general understanding of language, as 
well as their understanding of text and its underlying structures. 38 To provide 
information about instructional materials used for fourth-grade classes, students’ reading 
teachers were asked to report about the type of materials that formed the core of their 
reading program. Table 6.1 provides the results. 



35 A.P. Sweet Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement 1993). 

36 J.A. Dole, G.G. Duffy, L.R. Roehler, and P.D. Pearson. “Moving from the Old to the New: Research on Reading 
Comprehension Instruction,” in Review of Educational Research, 61. (1991). pp. 239-264. 

37 Jeanne S. Chall and James R. Squire. “The Publishing Industry and Textbooks,” in R. Barr, M. Kamil, P. Mosenthal, 
and P.D. Pearson, Eds Handbook of Reading Research, Volume II. (New York, NY: Longman, 1991). 

38 V. J. Harris. “Literature-Based Approaches to Reading Instruction,” in Review of Research in Education. (Washington, 
DC: American Educational Research Association, 1993). 
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According to Georgia public school reading teachers, in 1994: 

• Students in Georgia whose teachers used both basal and trade books 
demonstrated an average reading proficiency (209) which did not differ 
significantly from* that of students whose teachers primarily used basal 
readers (203). 

• The proficiency of Georgia students whose teachers used both basal and 
trade books (209) was not significantly different from* that of students 
whose teachers primarily used trade books (216). 

• The proficiency of Georgia students whose teachers primarily used trade 
books (216) was higher than that of students whose teachers primarily 
used basal readers (203). 
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TABLE 6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 






What type of materials form the 


Percentage and Proficiency 




core of your reading program ?* 










Primarily basal 




if i if 






1992 


29 {j&3) ft 


45 ( 4.8) |f| 




... 




gj|gj|:0 ( 2.6) || |ll| 


3.o) 






1994 


Jlf/ipba &a ) | 


!Ci JPBtP^o) 








@?ife03(23). \ | 


202(2.9)! 




.20 


Primarily trade books 


% t z. f'X i ??,' jj'f y t' 








1992 
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% tf 




1994 








20 ( 2.8) 






208 (10.7)1 


ty w. 


|-%r<2.9) 


Both basal and trade books 










1992 


viflffe ( 3J5) 






? J§| ( 3.6) I 








¥■% 




1994 


- ei ( 3.6) 










j||J|£9{3.6) , ■ ■ ' 




;» l 




Other 




-ft . 




' ’ j|£kit S£ Siift 


1992 
















if# 




1994 

o 


206 ( 






. ;197 f 



* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 



[ Although the difference may appear large, recall that 
Appendix A for further discussion.) 






lificance” here refers to “statistical significance.” (See 
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Teachers were also asked about their use of specific types of resources that can 
add depth and variety to the reading program (Table 6.2). Some selected results for 
public school students reveal that, in 1994: 

• In Georgia, 29 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines at least once a week. 
This percentage was not significantly different from that for the nation 
(30 percent). 

• The percentage of Georgia students who had reading teachers who used 
reading kits at least once a week (31 percent) was greater than that for 
students in the nation (21 percent). 

• The percentage of students in Georgia who had reading teachers who 
used computer software for reading instruction at least once a week 
(47 percent) was greater than that for the nation (24 percent). 

• In Georgia, 75 percent of the students had reading teachers who used a 
variety of books at least once a week. This figure was not significantly 
different from that for students across the nation (75 percent). 

• The percentage of students in Georgia who had reading teachers who 
used materials from other subject areas at least once a week (70 percent) 
did not differ significantly from that for the nation (69 percent). 
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TABLE 6.2 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Trial State Assessment 



Georgia 



Southeast 



Nation 



How often do you use the following 
resources to teach reading?* 

Children’s newspapers and/or magazines 
At least once a week 1992 



Once or twice a month 



Never or hardly ever 



Reading kits 

At least once a week 



Once or twice a month 



Never or hardly ever 



1994 

1992 

1994 

1992 

1994 

1992 

1994 

1992 

1994 

1992 

1994 



Computer software for reading instruction 
At least once a week 1992 



Once or twice a month 



Never or hardly ever 



1994 

1992 

1994 

1992 

1994 



A variety of books (e.g., novels, collections 
of poetry, nonfiction) 

At least once a week 1992 



Once or twice a month 



Never or hardly ever 



1994 

1992 

1994 

1992 

1994 



Percentage and Proficiency 
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(continued on next page) 
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TABLE 6.2 (continued) 

Public School Teachers’ Reports on Resources for 
Reading Instruction 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 




How often do you use the following 


Percentage and Proficiency 


resources to teach reading?* 














7 ".Tk ':'7 ; X : 


Materials from other subject areas 
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t 209(23) 
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t' 




;;7..,21T(3:p) 


k 305( 33) 


; ; 2f 3 ( 2.0) % ■ 


1994 


‘jy 22(2.6) :: 


=fv.':.-i3( : 32) 


• y;l2(3d) : l''' : 








:v.' ; : :?: 214 (:2:l) { ;'|.: . ■ 
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r-*(*) S- 


■f ^2 ( 23) T'£ 








•If:: .^2t7 (-:4.0 


4y-:217.<.33)y|.;: ; v i| 


1994 


li.- Je { i>) l . 


i • ye ( 23) ; 


if ; :'.9(i.6) | 




;i97(-Mp) 


■^■■■■20 3 < 8-4)1 ifH 





* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. 



Instructional Activities 

Teachers can nurture students’ developing reading ability by providing 
instructional activities that prepare students for a wide variety of specific reading 
tasks . 39 Effective activities support students’ understanding of the text being read and 
model the ways in which students can control the process of building meaning when 
reading on their own . 40 To provide information about the instructional activities in 
which fourth-grade students are engaged, the students participating in the Trial State 
Assessment Program and their reading teachers were asked to report on the frequency 
with which the teachers asked the students to do a variety of activities. The students’ 
and teachers’ responses are presented in the three following sections — workbooks, 
worksheets, and writing; discussions and group activities; and time to read. The 
students’ and teachers’ responses sometimes reflect different perceptions of the 
frequency of some activities. 



39 S.G. Paris. ‘Teaching Children to Guide Their Reading and Learning,” in Taffy E. Raphael, Ed., The Contexts of 
School-Based Literacy. (New York, NY: Random House, 1984). pp. 115-130. 



40 



A.P. Sweet. Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
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Workbooks, Worksheets, and Writing 

Some educators and researchers have suggested that children spend a 
disproportionate amount of time completing workbook tasks rather than receiving 
reading instruction or actively constructing their own understandings. 41 Analyses of 
workbook and worksheet activities reveal that many of these tasks require only a 
perfunctory level of reading. 42 Although we do not know what specific activities 
constitute time spent on workbooks and worksheets, such tasks rarely require students 
to engage in any extended writing. Writing activities have been found to incite 
children’s interest and involvement in learning about language and to enhance their 
reading comprehension. 43 To examine the use of workbooks, worksheets, and the 
reading/writing connection, students and their reading teachers were asked about the 
frequency with which teachers asked students to work in a reading workbook or on a 
worksheet or to write about something they had read. Table 6.3 provides these results. 

In 1994, according to the fourth-grade public school students in Georgia: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (53 percent) was greater 
than the percentage of students who were asked to write about 
something they have read almost every day (22 percent). 

• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (210) which was higher than that of students who did this 
activity less than weekly (201). 

• The average reading proficiency of students who were asked to write 
about something they have read almost every day (197) was lower than 
that of students who were asked to do this less than weekly (213). 



And, according to their reading teachers: 

• The percentage of students who were asked to work in a reading 
workbook or on a worksheet almost every day (28 percent) was not 
significantly different from the percentage of students who were asked 
to write about something they have read almost every day (24 percent). 



P.D. Pearson, L.R. Roehler, J.A. Dole, and G.G. Duffy. “Developing Expertise in Reading Comprehension,” in S.J. 
Samuels and A.E. Farstrup, Eds., What Research Has to Say About Reading Instruction . (Newark, DE: International 
Reading Association, 1992); R.C. Anderson, E.H. Hiebert, J.A. Scon, and I.A.G. Wilkinson. Becoming a Nation of 
Readers: The Report of the Commission on Reading. (U.S. Department of Education: The National Institute of 
Education, 1985). 

42 

J.R. Campbell, B.A. Kapinus, and A.S. Beatty. Interviewing Children About Their Literacy Experiences. (Washington, 
DC: National Center for Education Statistics, Government Printing Office, 1995); J. Osbom. “Workbooks: Counting, 
Matching, and Judging,” in J. Osbom, P.T. Wilson, and R.C. Anderson Eds., Reading Education: Foundations for a 
Literate America. (Lexington, M A: Lexington Books, 1985). 

43 

S.D. Miller, T. Adkins, and M.L. Hooper. “Why Teachers Select Specific Literacy Assignments and Students’ 
Reactions to Them,” in Journal of Reading Behavior \ 25(1), 69-93. 1993; D.C. Simmons, E.J. Kameeuni, S. Dickson, 
D. Chard, B. Gunn, and S. Baker. “Integrating Narrative Reading Comprehension and Writing Instruction for All 
Learners,” in Multidimensional Aspects of Literacy Research, Theory , and Practice. (Chicago, EL: National Reading 
Conference, 1994). 
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• Students who were asked to work in a reading workbook or on a 
worksheet almost every day demonstrated an average reading 
proficiency (199) which was lower than that of students who did this 
activity less than weekly (216). 

• The reading proficiency of students who were asked to write about 
something they have read almost every day (211) was not significantly 
different from* that of students who were asked to do this less than 
weekly (203). 
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TABLE 6.3 

Public School Teachers 9 and Students 9 Reports on 
Workbooks , Worksheets , and Writing 



1994 Tnal State Assessment 


Georgia 


Southeast 


Nation 


Teacher 


Student 


Teacher 


Student 


Teacher 
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How often do you (does 














your teacher) do each of 




Percentage and Proficiency 




the following as a part of 














reading instruction? 
















Ask students to work in a reading 
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212 ( 23) 
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: .;'53:.(‘1..6)i;< 


••|274&0fai 


75i;(.24). 


'26 ( 2.6) 


jsi :(i.3) 






199T5.8)J : ' 


210 (2;6) 


204 ( 4,3)1 


213 (24): 


207 12.5) 


'218 (13) 3 


At least once a week 
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55%8.5)|fe- 


>' *2ik(0 


■m,i 5.4)i ; 


26(2.6) 


.•::48.|3.4).4,, 


hS2B f 1.0) ^ 






212 ( 2.0)* 


21:4 (:2.l|; - : 


212 ( 2.5) 
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' : 218".(T!7) 7 
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;25( 1,0) 
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.^24 (15) I 


Ask students to write about 
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something they have read* 
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iSM <,1 
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220 (237 
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^22 ( lisf , 
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?§» ( 85 ) 1 
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2Q6 ( 5^| . . 


201 (34) 
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208(it.8) : 
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49 ( 5.8} 
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Less than weekly 
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’ i 26'(23) r 
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216 ( 1 . 8 ) 


211 (32) 
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17 ( 2.3) 
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:i5(3:if • 
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203 ( 3.7) 


213 ( 25 ) 
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211 ( 2.4) 
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* The question associated with this variable that was posed to teachers was reformatted in 1994. No trend comparison 
tests were conducted on the teacher data. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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Discussion and Group Activities 

Discussion-related activities are an important part of classroom learning, because 
they provide opportunities for students to ask questions about things they do not 
understand or want to know more about. A lack of emphasis on group work or the 
sharing of different interpretations limits opportunities students have for discovering that 
their reactions or interpretations may not be the only ones justified by the text. 44 
Furthermore, working in groups and discussing reading provide opportunities for 
students to develop language and communication skills that are necessary for literacy 
learning. 

To examine the prevalence of discussion-related activities, students and their 
reading teachers were asked about how frequently the students discussed new or difficult 
vocabulary, talked with each other about what they have read, or did a group activity 
or project about what they have read (Table 6.4). 

In 1994, according to the fourth-grade students in public schools: 

• About one third of the students in Georgia (34 percent) were asked to 
discuss new or difficult vocabulary almost every day. This percentage 
did not differ significantly from that of students across the nation 
(32 percent). 

• The percentage of students in Georgia who were asked to talk with each 
other almost every day about what they have read (21 percent) was 
somewhat greater than that of students across the nation (17 percent). 

• Less than one fifth of the students in Georgia (16 percent) were asked 
to do a group activity or project about what they have read almost every 
day. This figure was not significantly different from that of students 
across the nation, where 15 percent of the students were asked to do 
this. 



And, according to their reading teachers: 

• In Georgia, 67 percent of the students were asked to discuss new or 
difficult vocabulary almost every day. This percentage did not differ 
significantly from that of students across the nation (62 percent). 

• The percentage of students in Georgia who were asked to talk with each 
other almost every day about what they have read (33 percent) was not 
significantly different from that of students across the nation, where 
34 percent of the students were asked to do this activity almost every 
day. 

• A small percentage of the students in Georgia (3 percent) were asked 
to do a group activity or project about what they have read almost every 
day. This figure was not significantly different from that of students 
across the nation (5 percent). 



0 

ERIC 



J. Moffett and B. Wagner. “Student Centered Reading Activities,” in English Journal, 80. 1991. 
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TABLE 6.4 

Public School Teachers’ and Students’ Reports on the 
Frequency of Discussion and Group Activities 



1994 Trial State Assessment 
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Nation 
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Teacher 
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Teacher 


Student 








How often do you 


(does 














your teacher) do each of 
the following as a part of 




Percentage and Proficiency 




reading instruction? 
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* The question associated with this variable that was posed to teachers was reformatted in 1994. No trend comparison 
tests were conducted on the teacher data. ** The questions associated with these variables that were posed to teachers 
were reformatted in 1994 and the comparable questions posed to students were changed substantially. 1992 data are 
presented only for teacher responses and no trend comparison tests were conducted. The NAEP reading scale ranges from 
0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, 
for each population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the 
sample. In comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If 
the notation > (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) 
than the value for 1992 at about the 95 percent confidence level. ! Interpret with caution — the nature of the sample 
does not allow accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a 
reliable estimate. 
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Time to Read 



Independent reading continues to be a major contributor to reading fluency. 45 In 
contrast to completing workbook pages or computer drills, the reading of books provides 
practice in the whole act of reading. However, some studies have suggested that 
students may not be asked to read in school as frequently as is necessary to support 
literacy development. 46 

Both the fourth-grade students and their reading teachers were questioned about 
the frequency with which the teachers asked the students to read aloud or read silently, 
or gave the students time to read books of their own choosing. Table 6.5 provides this 
information. 

According to the fourth-grade public school students in 1994: 

• The percentage of students in Georgia who were asked to read aloud 
almost every day (50 percent) was larger than that of students across the 
nation who were asked to read aloud almost every day (45 percent). 

• About two thirds of the students (66 percent) were asked to read silently 
almost every day. This figure was not significantly different from that 
for the nation (64 percent). 

• In Georgia, 54 percent of the students were given time to read books 
of their own choosing almost every day. This percentage did not differ 
significantly from that of students nationwide (53 percent). 

And, according to their reading teachers: 

• More than half of the students in Georgia (61 percent) were asked to 
read aloud almost every day. This figure was not significantly different 
from that of students across the nation, where 57 percent of the students 
were asked to read aloud almost every day. 

• The percentage of students in Georgia who were asked to read silently 
almost every day (73 percent) was not significantly different from that 
of students across the nation (74 percent). 

• About two thirds of the students in Georgia (68 percent) were given 
time to read books of their own choosing almost every day. This did 
not differ significantly from the percentage of students across the nation 
(69 percent). 



45 

I. Wilkinson, J.L. Wardrop, and R.C. Anderson. “Silent Reading Reconsidered: Reinterpreting Reading Instruction 
and Its Effects,” in American Educational Research Journal , 25(1). (1988). pp. 127-144; C.S. Huck. “Literacy and 
Literature,” in Language Arts, 69. (1992). pp. 520-526. 

46 R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading . (U.S. Department of Education: The National Institute of Education, 1985); M.A. Foertsch. 
Reading In and Out of School. (Washington, DC: National Center for Education Statistics, 1992). 
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TABLE 6.5 

Public School Teachers 9 and Students 9 Reports on the 
Frequency of Reading in Class 



1994 Trial State Assessment 
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y 213(fl5)"1 


1994 


#23#.5)sS^ 


, 




• m im a 


:423‘( 2.3)ty 


, 23 ( 03) 




202 ( 3:5) 


207(2^5) 


2061(3.0 P" 


339(2.7) 


:: 210 ; f 2.5)|' ; 


6 2t3.(Ti) .‘5 


Less than weekly 1992 




* 


f:2j(-1^)fc 




2(0,5) 


hinmi 




***r.*.*) : 


194 ( 3;1) 




193(311) 


207 1 5.5)jt 


;T93(2#I) ; 


1994 






c 2 ( 05) 


a ? #4(0.9H 


2^0.7#- 






205 ( 6.0)! 


178 ( 4*6) < 




186(33) 


;209 |7.9K; 


188 ( i|9) 


Give students time to read books 




‘4 i * 1 








■% 


they have chosen themselves**** 


L'\ . • 'l'; 


•> j ' vt. ■ ■ < 






* •' : : r- 


v , . ^ '1 


Almost every day 1992 






&*#&*§* 


-a0( : 2.6) ^ 




^ >55:(T&)- 1 






2iS { Wl , 




.216( 3.3) : 




222(113) 


1994 


68 ( 2 . 6 )'r ; 

211 ( 2.5) ; 


Gertie) :■ 

214 ( 2.3) ; 


'• 62 ( 6.8) '': 
210 ( 2.5) 


215 (216) 


215 ( 1.4) 


53 W) 

2^) ( 151} 


At least once a week 1992 




*29 ( 1-0) 








. V ri:5: ' * ... 




1 


. ^0(2:0) o 


£ 


.2*1 {<25) 




/2i4.(.ii7) 


1994 


25 ( 25). 


29 (^ : 


" 31( 6.4) 


30 ( iS) * 


■•25^241'" 


^ (Si) 




203 ( 3.6) , 


207 ( 23) 4 


203 ( 4.4) 


208(3.0) 


: ;2t0,( 2,5)/>; 


• 2T12 .< .Tj|6) , 


Less than weekly 1992 


: ~ ("•*> 


T6 ( 0:8) 




21 ( L6) 


" 


18 ( oi) " 




1*- $W*~ 


201 ( 24) i 




201 ( 6 : 0 ) a 




202(114) j 


1994 


7 ( 1.8) 


17(t*0) 


7(3.4) 


20 ( 12) 


6(i.2r 


18 ( 017) ' 




196 (S;4)! 


194 ( 4:5) 


r«**,£**~*^ y ., \ 


199(2.8) : 


207 ( 4.9) 


204(213) >] 



* The question associated with this variable that was posed to teachers was reformatted in 1994. No trend comparison 
tests were conducted on the teacher data. ** The questions associated with these variables that were posed to teachers 
were reformatted in 1994 and the comparable questions posed to students were changed substantially. 1992 data are 
presented only for teacher responses and no trend comparison tests were conducted. **** The question associated with 
this variable that was posed to teachers was changed substantially in 1994. No 1992 data are presented for teacher 
responses. The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
! Interpret with caution — the nature of the sample does not allow accurate determination of the variability of this 
statistic. *** Sample size is insufficient to permit a reliable estimate. 
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Reading and Use of Libraries 

Analysis of schools that have been successful in promoting independent reading 
suggests that one of the keys is ready access to books. 47 Libraries can be a major 
resource in developing students’ reading abilities because students can use them as quiet 
places to read as well as to check out books and to obtain reference information. 48 Thus, 
to examine library use, students’ reading teachers were asked about the frequency with 
which they sent or took their reading classes to the library and assigned students to read 
a book from the library. Table 6.6 provides the results from public school teachers’ 
reports about the frequency of sending fourth-grade students to the library. 

• In 1994, a large majority of the students in Georgia (81 percent) had 
reading teachers who sent or took the class to the library at least once 
a week. This percentage was not significantly different from that of 
students in the nation whose teachers sent or took the class to the library 
with the same frequency (86 percent). 
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TABLE 6.6 

Public School Teachers’ Reports on Sending Students 
to the Library 



1994 Trial State Assessment 


Georgia 


Southeast 




Nation 


How often do you send or take 


Percentage and Proficiency 




the class to the library?* 










At least once a week 




tiyil . 


r ■ ; 


\x 


1992 








85(2.7) 




'h y , «2i4 


. 213(3.6) . 


ill 




1994 


81 ( 23) 


86(4.9) 








U‘b : 2DB('zsyg:^ 


209 






Once or twice a month 










1992 


%V C2*>' : 3 










( 4.4) 


vl/fyZ 10 ( 8.0)! ft|H 




*S2C 


1994 




( 4.4) | „ ' h 


f } ,< % 






!§! 








Never or hardly ever 




4. f/kt iiti ; ? v : 






1992 








mmm 




.209(4.0)1 | 


mMM&M 






1994 


6(1.6) - 


■ ■ 2 ( 1.0) 




Wi Wx 








' - 








''.'■**:*■* ' >. m ■ > ■ 3# 




yf-.y. /.a : ; 



* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 




48 



R.C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

K.C. Lance, L. Welbom, and C. Hamilton-Pennel. The Impact of School Library Media Centers on Academic 
Achievement . (Castle Rock, CO: Hi Willow Research and Publishing, 1993). 
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Table 6.7 provides the results about public school teachers’ reports on the 
frequency of assigning students to read a book from the library. 

• In 1994, more than half of the fourth graders in Georgia (58 percent) 
had reading teachers who assigned reading a book from the library at 
least once a week. The percentage of students whose teachers assigned 
reading library books this often was smaller across the nation 
(47 percent). 
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TABLE 6.7 

Public School Teachers 9 Reports on Assigning Books 
from the Library 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 




How often do you assign 








students to read a book from 


Percentage and Proficiency 


the library?* 








At least once a week 


jL fit r v:> 




7 jfll . , J^i ’ ija . i-| 


1992 




3.3)^! 


50(2.8) 




2f 1 { 1.7) 


; V;;| 2 bs < 2 . 9 ) ^ 


216;{j1.6) il 


1994 










. £07(3.5) 


; 208 ( 2.9)r 'jf 




Once or twice a month 


i .* Js & 






1992 




3f •• Y' -'if 






£ 2:13(29) Ufa], 


. 2T4 < 4:7]| ; ; .• 




1994 


W ’Iffe ( 2.9) ' 


1®?** 






r- 214(;2;6).. Jy: 


;g 205 <3;6)fl :-M 


2.0)1 


Never or hardly ever 


'{■\i ■ 


,a. f 




1992 


: %0 ( TJ3) : 


i :22< 5.i)S^ W 


- W Vistf EapP * | 








rJ 


1994 


Ilf 








■ 197(3.6) ^ : 


Ui; ' - 213 ( 5.8)1 ..xli 


.,/& ,21 3(3.2) ,>> 











* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). Percentages may not add to 100 because a very small percentage of teachers 
reported that there was no library at their school. ! Interpret with caution — the nature of the sample does not allow 
accurate determination of the variability of this statistic. 
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Assessing Progress in Reading 



Ten years ago, the authors of Becoming a Nation of Readers argued that 
standardized tests do not always provide a deep assessment of reading comprehension 
and should be supplemented with observations of reading fluency, critical analysis of 
lengthy reading selections, and measures of the amount of independent reading and 
writing done by children. 49 

Over the last decade, reforms in classroom assessment have been called for at 
numerous levels. Many educators have begun to utilize assessment methods that are 
more instructionally-relevant and performance based. 50 At the same time, policy makers 
and the interested public have called for educational assessments that measure the more 
integrative, complex abilities that are associated with advanced achievement. 51 

Fourth-grade students’ reading teachers were asked a series of questions to report 
on how often they used different types of assessment measures — including 
multiple-choice tests, longer extended constructed-response questions, and reading 
portfolios — to assess student progress in reading. The use of reading portfolios 52 is 
an emerging assessment technique that may not be widely used in many schools. From 



• In 1994, about one fifth of the fourth-grade public school students in 
Georgia (22 percent) were assessed with multiple-choice tests once or 
twice a week. This figure was greater than that for the nation, where 
12 percent of the students were similarly assessed. 

• The percentage of students in Georgia public schools in 1994 who were 
asked to write paragraphs about what they had read once or twice a 
week (35 percent) was not significantly different from that of students 
across the nation (39 percent). 

• In 1994, about one quarter of the fourth graders in public schools in 
Georgia (23 percent) were assessed by using reading portfolios once or 
twice a week. This percentage was larger than that of students across 
the nation (15 percent). 



49 

R. C. Anderson, E.H. Hiebert, J.A. Scott, and I.A.G. Wilkinson. Becoming a Nation of Readers: The Report of the 
Commission on Reading. (U.S. Department of Education: The National Institute of Education, 1985). 

50 S.W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities . 
(Newark, DE: International Reading Association, 1994). 

51 G. Wiggins. “Assessment: Authenticity, Context, and Validity,” in Phi Delta Kappan. (November, 1993). pp. 
200-214. 

52 

S. W. Valencia, E.H. Hiebert, and P.P. Afflerbach, Eds.. Authentic Reading Assessment: Practices and Possibilities. 
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TABLE 6.8 

Public School Teachers’ Reports on Assessing 
Progress in Reading 



1994 Trial State Assessment 




Georgia 


Southeast 


Nation 








How often do you use each of the 










following to assess student 


Percentage and Proficiency 




progress in reading? 












Multiple-choice tests* 




'f-f ; 








Once or twice a week 


1992 


20(2,5);^ ; 


if 22 (4.2); . 7% ■ 


r ;<;i4(.:2.i) 










204 : ( 4.2)f 


*:|-||S-208 ( 3.1) 


, ’ "ri| c 




1994 


22 ( 2.8) I : 


' 17£3.6) ' 


i ?lf 12 f ia9) 


•>i*. 






208 ( 3-4) : ; 


!;% 206(5.7)!; Jt 1 


: ,;ir.2ti < 3.i) 




Once or twice a month 


1992 




■ • i 


•?!y>:'.49i3a).J 








... afei 


215:.(:2.5) ' < Tf-3 


1: M5:21? tf.7) 


' ' 3 >iu, 




1994 


54{3.i>-::^ . 


' - 59 ( a9) XM 


. ;|}l • 49C2:1) 








207'('3 < 8):|B-,;-< 


3j£: 208<i2.7),.:;.^;-: 


;lpid2l2i#1 : -77).: 


: 


Once or twice a year 


1992 




8 ( 2.6) ! 


15 ( 2^2) " 






205(5.3) :: 


; 209 (-3.3)! . g. ' 


J : < - ? 220 ( 2.5) 






1994 


;.*0& 






j ; i: 








-g#; 216 ( 4.2) 




' r 


Never or hardly ever 


1992 


e <i-4)H 


11 (4.3) 


• 21(3.4) 








in. : 2.15 <4,2)*. 


219 (15.4)1 


• ^i:ig:.2iac3^)^ 






1994 






; 22 (2,3) ' 


V iv|:i|f' 






r 2l:8 : {4.5)i;||; 


fHjg .204^6,4)1' ff :: 


■ /;|:;2i5.(Si7) 




Paragraph length written responses 


4 . ’j 








about what students have read 


|3|gp?- : 


*43* * 




p 1 


Once or twice a week 


1992 




K:t.! w s ' IT ■ . 


rf^ '(5^' 


‘ ; y ip ' 






i?: ■ 




/Ig;. — (-1-) 






1994 








::: 






215^ 3* ; 


! W 213(3-0) 


; ;f||215:(<1 : :5)" 


'C' 


Once or twice a month 


1992 




- • M 


; 


• ' ■■■&;. 






:,0Xrr-) 










1994 


rs ^8'< 3.1$-S|T 




' - ; J5^44 : (^)“ < 


> . 








• 208 (!2,4) ; : fe 1 


S|^214 <lb5) 


• • .^c 


Once or twice a year 


1992 


j£- . v , :~t(~.~) ijflga 












W\ 


i f ' y *— •(—>) ■ 




* 5 & 




1994 


V: -' j 


:1Ti?2,4) :ft ■ 


10(1.4) 


'JM 








2£ 207 ( 5.9)1 


213(3.4) 




Never or hardly ever 


1992 


!<■ : 


.... - (»».••) - 










r ‘ tel - ;-: 






-5: 




1994 


11 < 2.0);;^,.: 
195 ( 3.9) 


13^4.0)/^ 


.mk^04),. 


v .;-v«p 


Reading portfolios" 




•'*’ • * : v*h ‘ : 






- • 


Once or twice a week 


1992 


^ ,24;C2.6> [|v . •' 


yii; 




‘ w,.|0: 








, .218(12.7)! 






1994 


&■ ' Sftz&fc i 5 


[■'if. ^ i7 ; (-3jij 


ts ( te) 








.. - ' . 


ii-; mtvn-iJv 


V it -209 ( £4) 
25^(#3):.. 


-Si 


Once or twice a month 


1992 


k&j 32-<3^)f24- 


•■tsk 


. - 

r'^W 






!>: ■ • 2l¥'( 29).Sr 


21 8(5-6)! |3"; 


v #221 (^4) 


■ #??»■ 




1994 


' 32 {33)Sf- •’ 


^>(3.8) 


; tt" 26 ( 2.6) 


' i?'; 


Once or twice a year 


1992 


ik,v 

!<*•' t4| 2.3).4" 


232 |;5.4)! :J 
T4'( s 33) ! ; 


ii^2‘<#) 
■ w® 


"if 
. i i & 






214(3.6) 


' 214(8.4)1 -I..: 


216 ( 3 7) 






1994 


t 

!>’ 208 ^ Sfcaj.Sff ;/ * 


'.«» ' 209 ( 3.8)1 .^*..4 


16(2.0) 

• • ^1217 : C2^)’ ' 


gfil: 


Never or hardly ever 


1992 


31 (3.4) 


52(8.0) - 


47 ( 3.3) 


* tr 






2ii (2.7) - i . . 


••;.vr 208(1.4) 


t 214 ( :i4) 


.. C g: 




1994 


; 3d'-< 3,3)i4 ; ;‘" : 


^••46(gas)-^ 




.. 






206(2.9) 


207 ( 3.3) ■. 


: 214(1^8) 


- - 7 . .. 



* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

— The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment. The NAEP 
reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said with about 

95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 standard errors 
of the estimate for the sample. In comparing two estimates, one must use the standard error of the difference (see 
Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate determination of 
the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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CHAPTER 7 



Who Is Teaching Reading to Fourth Graders? 

Preparation and Experience 

Many states have begun to raise teacher certification standards and strengthen 
teacher training programs. In curriculum areas requiring special attention and 
improvement, such as reading, it is particularly important to have well-qualified teachers. 
To provide information about the staff who are teaching reading to fourth-grade students, 
the Trial State Assessment Program gathered details on the educational backgrounds of 
the teachers of the assessed students. Table 7.1 summarizes fourth-grade public school 
teachers’ responses to questions concerning their academic preparation, certification, and 
their years of elementary or secondary teaching experience. In 1994: 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Georgia (48 percent) was not significantly different from* that for the 
nation (41 percent). 

• Less than one fifth of the students (17 percent) had reading teachers 
who had the highest level of teaching certification that is recognized by 
Georgia. This was smaller than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Georgia, 16 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was not significantly different from the percentage 
of students across the nation who were being taught by reading teachers 
with the same major (20 percent). 

• The percentage of students in Georgia who were taught reading by 
teachers who had a graduate major in English, reading, and/or language 
arts (12 percent) did not differ significantly from that of students across 
the nation (13 percent). 

• The percentage of students who were being taught reading by teachers 
who have taught at either the elementary or secondary level for at least 
11 years (including part-time teaching) in Georgia (51 percent) was 
lower than that for students across the nation (67 percent). 



* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 
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TABLE 7.1 



Public School Teachers ’ Reports on Their Fields of 
Study and Teaching Experience 



1994 Trial State Assessment 



Georgia 



Southeast 



Nation 



What is the highest academic degree you hold? 



Bachelor’s degree 


1992 




: 






”71 


- 




1994 


52(2.8) 


; 




59 ( 5.8) 


.'I 


59 ( 27): : 


Master’s or specialist’s degree 


1992 








• -.'*&)■ : 


: ;8 






1994 


48(2.8) 






41 ( 5.8) 




R •4i;(2.7)R 


Doctorate or professional degree 


1992 




if 




i^m: 




•• 4-l.R 




1994 


6.6) 


|iC ' 




5 -v=o (fpf 






What type of teaching certification do you have 








[ . i • '|f-‘ 




i R RfifRlR 


that is recognized by Georgia? 






III' 5 -' 




rK; 




; * v ; R : RrHRRR:' R' 


None, temporary, probational, 




*• • • 1 1 ’ * • 1 : 


■ 








: ; ' Rl .Si;. 


provisional, or emergency 


1992 








!:& (ids 


w 






1994 








jy£ c # $ 


- 


6(1.3) 


Regular certification but less 
than the highest available 


1992 


SiliiJ 






ill SW 


'/iR 
: : • : -i'R-R 
V y'}' 






1994 


81 ( 22) 


:’Ci- •- 




; 47.(|5;8)- 


. 


■ ;;a®( • 


Highest certification available 


1992 


lilies 


; 








IttliSSIB 




1994 


RJiRi 






50 |§§|!' 




'■ '?/.■%£ :V 


What was your undergraduate major? 


' * ; 


. 


' 


foil 


/:• 

: 


I* - Hill 


English, reading, and/or language arts 


1992 








— (-.-) 




flp 


Education 


1994 

1992 




| ; 


, s i 


13 ( 1:8) 


:J. \*k 






1994 




j§l|: 




80 ( 3.6) 


Y(M 


'G6;t2.3y-.i£l 


Other 


1992 






y 




.. ;f ;/?. 






1994 


i.3> 




m 


1 7(2.6) 


■ 'i 




What was your graduate major? 






v;: :£; : 


l §j 


lllfilli 


: < 




English, reading, and/or language arts 


1992 






yi 


0851 


:m 




Education 


1994 

1992 


lift 

f 


f*i ft? 




8(1.8) 


: 

ww 






1994 


U.S .58 ( 2.7) 




||| 


56 ( 3.8) ; 


; i!i 


,r:-s4(£t) r- 


Other or no graduate level of study 


1992 


- (-•-) 




yv 


IPBI 








1994 




•ii 




35 ( 3.8) 


R 




How many years in total have 


you taught at 




R 
: ; 


; 




11 




either the elementary or secondary level? 
2 years or less 1992 


11 (2.4) 


Iff 


41* 


Is?!®)! 


Ri 

'RIr 




3-5 years 


1994 

1992 

1994 


.13(1.9) 
•-R 12:( 15) 


ggfji- 

i 1:1 


'|ri4 (23^ 


r-4 


iff, 

-•■'■ssq ■ 


6-1 0 years 


1992 

1994 


^'-20.<2.4) 


%A f 

Iff 


il 


12(2:6) 

|§||pjS 


■ 


l S3! 


11-24 years 


1992 




III * 


<■ ■ 


50(S:1); 


♦ ^ 




25 years or more 


1994 

1992 




flC: 


: RSf : 


15(32) 


• • 

M 


Y'l Kpw'vjS'mtfr-V 

: - ib 




1994 




iy- 


/¥..f 




m 





Percentage 



— The 1992 data are not reported for this variable due to a rewording of the question for the 1994 assessment 
The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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Professional Development 

Teachers were also asked about the amount of time they spent in staff development 
workshops or seminars dedicated to reading or the teaching of reading during the year 
immediately preceding the Trial State Assessment Program. From Table 7.2, in 1994: 

• In Georgia, 24 percent of the fourth-grade public school students had 
reading teachers who spent at least 16 hours in staff development 
workshops or seminars dedicated to reading or the teaching of reading. 

This figure was lower than that for the nation (36 percent). 

• The percentage of students in Georgia public schools whose reading 
teachers spent no time on staff development workshops or seminars in 
reading or the teaching of reading (16 percent) was higher than that of 
students across the nation (10 percent). 
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TABLE 7.2 

Public School Teachers’ Reports on Time Spent in 
Staff Development Workshops and Seminars 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 




During the last year, how much 








time in total have you spent in 








staff development workshops 




Percentage 




or seminars in reading or the 








teaching of reading?* 




v .^ . r • 




None 


: < v: • ' r ,.' : ::-vt . 




• 7^1; : >J£' • ' : 1 


1992 


, 12^2.0} 






1994 




7 ( 2.4) '|||f 




One to 15 hours 




I « imi 


; ' \ 1 ■ • ':?• : ; .JiX 


1992 




• ! 69 


:60 ( 2.9) 


1994 




: 56(5*) JQ- 




16 hours or more 


l ig, .Mr: 


: • U ^jjf& ‘ ' . ■ V" 




1992 








1994 


: 24 (2J5) r:^ 


; ■ • 37 |5i2) '• ; 9;‘; 


•' 1-36 ( 218) • ’A 



* The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). 
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Finally, teachers were asked to report on whether they had training in specific 
aspects of reading during the past five years, either in college courses or through 
workshops. As indicated in Table 7.3, regarding fourth-grade public school students in 
1994: 



• In Georgia, 77 percent of the students had reading teachers who reported 
that they had training in teaching critical thinking skills. This was not 
significantly different from the figure for the nation, where 78 percent 
of the students had teachers who reported having such training. 

• A large majority of the students in Georgia (87 percent) had reading 
teachers who reported that they had training in combining reading and 
writing. This percentage was not significantly different from that for 
students across the nation (89 percent). 

• A large majority of the students in Georgia (86 percent) had teachers 
who reported having training in the whole language approach to teaching 
reading. This percentage did not differ significantly from that for the 
nation (85 percent). 

• In Georgia, 71 percent of the students had teachers who reported that 
they had training in reading assessment. This figure was not 
significantly different from that for students across the nation, where 
67 percent of the students had teachers who had training in reading 
assessment. 
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TABLE 7.3 

Public School Teachers ’ Reports on Training in 
Specific Reading Areas 



1994 Trial State Assessment 


Georgia Southeast Nation 


During the past five years , have 
you ever had training in any of 
the following? 

Teaching critical thinking 

1992 

1994 

Combining reading and writing 

1992 

1994 

The whole language approach 
to teaching reading 

1992 

1994 

Reading assessment 
1992 
1994 


Percentage 

77(S«) 11(111 dll.' 



The standard errors of the statistics appear in parentheses, it can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 
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CHAPTER 8 



Students’ Home Support for Literacy 

A multitude of home and attitudinal variables may affect students’ reading 
achievement. 53 In addition, good readers usually interact with a wide variety of 
materials on their own, and share their experiences with family and friends. 54 Thus, it 
is important to understand students’ attitudes toward reading, the extent to which 
students read on their own, and the degree of home support that is available for reading. 
To examine these factors, students participating in the Trial State Assessment Program 
were asked a series of questions about themselves, their parents or guardians, and home 
factors related to reading. 

Reading Outside of School 

Because of the increasing concern for students’ independent reading 
habits, 55 students participating in the Trial State Assessment Program were asked to 
report on how often they read for fun on their own time (Table 8.1). They also were 
asked about the number of books they have read on their own outside of school during 
the month preceding the assessment (Table 8.2), and how often they have taken books 
out of the school library or public library for their own enjoyment (Table 8.3). 



53 J.T. Guthrie and V. Greaney, “Literacy Acts.” in R. Barr, M. Kamil, P. Mosenthal, and P.D. Pearson, Eds,, Handbook 
of Reading Research: Volume II. (New York, NY: Longman, 1991). 

54 A.P. Sweet Transforming Ideas for Teaching and Learning to Read. (Washington, DC: Office of Educational 
Research and Improvement, 1993). 

55 L.G. Fielding, P.T. Wilson, and R.C. Anderson. “A New Focus on Free Reading: The Role of Trade Books in Reading 
and Instruction,” in T. Raphael and R- Reynolds, Eds., Contexts of Literacy. (New York: Longman, 1990). 



THE 1994 NAEP TRIAL STATE ASSESSMENT 




91 



Georgia 



The results are provided in Table 8.1 regarding how often fourth-grade public 
school students reported reading for fun on their own time. 

• In 1994, 45 percent of the students in Georgia reported that they read 
for fun almost every day. This figure did not differ significantly from 
that for the nation (45 percent). 

• In Georgia in 1994, the average reading proficiency of students who read 
for fun almost every day (214) was higher than that of students who 
reported that they read for fun once or twice a month or less (195). 
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TABLE 8.1 

Public School Students * Reports on the Frequency of 
Reading for Fun 



1994 Trial State Assessment 





Georgia 


Southeast 


Nation 


How often do you read for fun 


Percentage and Proficiency , 


on your own time? 








Almost every day 

1992 




;f|fl 


' ' 

■if 

43(1-0) , •; 








wwm&smm 


1994 






|gi^(;p.7) 




fllif 214 ( 2 ..6} ft i|M 


217(28) 


m iw 


Once or twice a week 






1992 


: 32 { 1 0) 


Hi ^ 1 1.6} . : 


VP a, 

32 { 0.3) 


1994 


;214 ( 1.8) 
207(2.9) 


33 ( 0.8) |J§j| 
208 ( 2.7) 


217(1.3) 

•jgr* . >,f ! ;:Si ® 

H|I ; 31 (0.7) ■ : 


Once or twice a month 

1992 






12 ( 0.5) 




205 


002 07(;3:$ ,;0 , 


208(1.8) 


1994 






; 12 <:p.5). 




201 | 3.0) 


0|i?9Ta8) 0 ;0 


209 ( 2.3) 

Il2 ; j ; - jfe ■ -pit: ff. 


Never or hardly ever 






1992 


43 ( 0.7) \ 






1994 




200(3^/0^ 


' , " 198 ( 2.0) 




14(0.8) : 






190 ( 32) IS 







The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Concerning how many books were read by fourth-grade public school students in 
Georgia, Table 8.2 reveals that: 

• Less than half of the Georgia students in 1994 (44 percent) read five 
or more books on their own outside of school in the month preceding 
the assessment. This figure was not significantly different from that of 
students across the nation, where 42 percent of the students reported 
reading the same number of books. 

• In 1994 in Georgia, average reading proficiency was higher for students 
who read five books or more on their own outside of school during the 
month prior to the assessment than for students who read no books. 
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TABLE 8.2 

Public School Students’ Reports on the Number of 
Books Read Outside of School in the Past Month 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 


During the past month , how 
many books have you read on 


Percentage and Proficiency 


your own outside of school? 








None 


; ; v' s ; ; - 


' • • ' ’ll 




1992 


: 6 ( 0.4) V 


9(0.9) j 


5,7(0 A) 




198(3.25 




: ‘196 ( 2.6) \ | |i % 


1994 


; iij lec&.6) 


:|St 

' w i \crp { 3 v>> j - ^ 


9 ( 0.6) 

Ill ^ i 92 T 2 51 ^8^4: 


One or two 






V • ' h ’ 


1992 


: 1 f 




■^r-25<o.s) 




' 2tO:if.O) 


r’j/l’feii (at) 


214(1 £) , 


1994 


.. , 254 0.9) > •*' : 




426(0.8) 










Three or four 

1992 


22 ( 0.9) 


f^vl-22'(13) ' '’'f': 






214i2J0) : ;' . ; ! :\ 




^:;219(i:6)f'S|j : | 


1994 


zzmm 




23(0.6) |;:>j 




■ 207 ( §3& '** • 


212(23) / 


216(1.8) 


Five or more 


• . .. [/$.%:/:■ •. 


• ■ • " • * ’ "• : * 


. • •* '. ■ %*’ ' 


1992 




'ASM* 42 ( 2-2) : 


;<7 ; : y A 4.(13); 






s fi!i 


217(1.3) 


1994 




: -4z i\s) 


.ff iV 42 ( 0.8) : 




211 $23) 


210(2.7) 


215(1.4) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Finally, regarding the frequency with which students took books out of the school 
library or public library for their own enjoyment, from Table 8.3: 

• In Georgia in 1994, 63 percent of the fourth-grade public school 
students took books out of the library for their own enjoyment at least 
once a week. This percentage did not differ significantly from that for 
the nation (63 percent). 

• In 1994, public school fourth graders in Georgia who took books out 
of the library at least once a week had an average reading proficiency 
(208) that was higher than that of students who never or hardly ever took 
books out of the library for their own enjoyment (192). 
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TABLE 8.3 

Public School Students’ Reports on the Frequency of 
Taking Books Out of the Library 



1994 Trial State Assessment 



Georgia 



Southeast 



Nation 



How often do you take books 
out of the school library or 



Percentage and Proficiency 



enjoyment? 


'/ V/V $ 'vftv* ' iJ 






Almost every day 




If 




1992 


0.7) : 


m 


0.6) 










1994 




; / i5(i.i) 


lltS'llt 0.5) 




200 




207 (1.9) 


Once or twice a week 








1992 




Ip 45 ( 13) Tr’lsf 


V 48 (0.9) 




y.t lx 


J|T 


:219 ( 12) 


1994 


.45(1.3) 


M i 


ililliiii 




212(2.4) 


215 ( 2.5) 


IvH 220 


Once or twice a month 






1992 


1 ; 0.8) 4 1| ifcft 




|?|i I<: ; .22 ( 0.8) 




ii s&rara 


Hu 


|||;; :>.219 ( 1.4) 


1994 




, 22(1.6) 


^ 21 (0.8) 




<kmmm 


1 


llipiUllH 


Never or hardly ever 
1992 




r 19(1.3) 


\\ 15(017) 




i W < t '2804 '£$),$. j : && m 


■ 201(3.6) ■ 


Ip: 

CO 


1994 


ISRsiffll 


£?. ; f*9g|p3): 





ft'flfS 

Pfrifi 









The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Reading in the Home 

The presence of parents or siblings who model and share reading and the 
availability of reading materials in the home are critical factors in the development of 
students’ appreciation of reading and, ultimately, their comprehension and fluency. 56 
Students participating in the Trial State Assessment Program were asked about the 
availability of newspapers, magazines, books, and an encyclopedia at home. They were 
also asked about the frequency with which they discussed things they had read with 
friends and family. 

Average reading proficiency associated with having zero to two, three, or four of 
these types of materials in the home is shown in Table 8.4. The data for public school 
fourth-grade students in 1994 reveal that: 

• In Georgia, 32 percent of the students reported having all four of these 
types of materials in the home. This figure was somewhat lower than 
that for the nation (36 percent). 

• Students in Georgia who had all four of these types of materials in the 
home showed an average reading proficiency (225) that was higher than 
that of students with zero to two types of materials (191). 
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TABLE 8.4 

Public School Students’ Reports on Types of Reading 
Materials in the Home 



1994 Trial State Assessment 


Georgia 


Southeast 


Nation 










Does your family have , or receive on a 








regular basis t any of the following items: 
more than 25 books, an encyclopedia, 
newspapers, magazines? 


Percentage and Proficiency 


Zero to two types 






■fl J||& Z . . 


1992 


b* 

oo Ky 


(2:0). ; ** 

|k)3{:2.1) 


. 203 { 03) : pi 


1994 


t#34 fi&O) 








191 ( 32) < f C 


, |l95(22)<-;|j ( r 




Three types 




i / , jjl 




1992 


" r ; 


'¥ 30 


‘3 ■ 32 {6.7) 






f2t2( : 3A). 


, [217 (1,5) 


1994 




: • 






208 (2.4 ) ; ; 


C210(2.3) 


• 4214 (J.3) ; J; * 


Four types 


: : .rjfe s ‘ 


u 




1992 


••• . 31 <1.2) 


1 32(2.4) 


36(tibj 




• 224(1.8) 


( 32) 


;|224 ( 1;4) Ji\ l 


1994 


t 32 0i5) '!:? 


^30 (is)' 






225(2.7) 


221(2.1) 


:i225 ( 1,2) *;.j 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 




56 L.C. Moll. “Literary Research in Community and Classrooms: A Sociocultural Approach,” in B.D. Ruddell and H. 
Singer, Eds.. Theoretical Models of Reading. (Newark, DE: International Reading Association, 1994). pp. 179-207; 
B. Rogoff. Apprenticeship in Thinking. (New York, NY: Oxford University Press, 1990); D. Taylor. Family Literacy: 
Young Children Learning to Read and Write. (Exeter, NH: Heinemann Educational Books, 1983). 
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Regarding the frequency with which fourth-grade public school students discuss 
what they read with friends and family, Table 8.5 shows that: 

• In 1994 in Georgia, 31 percent of the students discussed with friends 
or family what they read almost every day. This percentage was 
somewhat greater than that of students across the nation (28 percent). 

• In 1994, the proficiency of students in Georgia who discussed what they 
read with friends or family almost every day (204) did not differ 
significantly from that of students that had discussions with friends or 
family less than weekly (207). 




TABLE 8.5 

Public School Students ’ Reports on Talking With 
Friends and Family About Reading 



1994 Trial State Assessment 














Georgia 




Southeast 


Nation 




How often do you talk with 












your friends or family about 




Percentage and Proficiency 




something you have read? 












Almost every day 


: 










1992 






30 { 1.2) 


1; 






\ 208(1.9) : 




gfpi 


ill!! 




1994 


WPSLo) 




; 30(1.8) 








yyll 204 ( 2.5) 


illj 


207 ( 3^)tj -# ;r 






Once or twice a week 




Hill 




, \ i|| 


fffl 


1992 


jiSS 


ifii 




i^S35 (1.0) ' 


rit'-V?:' 


1994 


:.?38 


WM 


3fir 


.i;SP}^;35(0.7) 


fj 


Less than weekly 
1992 


2*12 ( 3.0} Jj 

/tjl; §35‘ ( 1-0) # 


W&k 


i 37(2.1) : if§i 


38 (1-2) - 










* 209 % 


M ;210(T.3) 


1994 






'Hip 




Pi* 








- 1 


yli:t;208(T5) 


1«» 












5- - " ✓ * 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Hours of Television Watched Per Day 

Many avid student readers watch a lot of television, while other children neither 
watch much television nor read. 57 However, despite these findings, it is generally 
believed that television viewing has an effect on time given to reading — frequent 
television viewing limits the amount of time available for other activities such as 
reading. 58 Students participating in the Trial State Assessment Program were asked to 
report on the amount of television they watched each day. Table 8.6 shows that, in 
Georgia public schools in 1994: 

• About one fifth of the fourth-grade students (22 percent) watched six 
hours or more of television each day. This was not significantly 
different from the figure for the nation, where 22 percent of the students 
watched this much television. 

• Average reading proficiency in Georgia was lowest for students who 
spent six hours or more watching television each day. 




57 S. Neuman. “The Home Environment and Fifth-grade Students’ Leisure Reading,” in Elementary School Journal, 
83. (1986). pp. 333-343. 



58 



P. Heather. Young People’s Reading: A Study of the Leisure Reading of 13-15 Year Olds. 
University of Sheffield, Center for Research on User Studies, 1981). 



(Sheffield, England: 
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TABLE 8.6 

Public School Students’ Reports on the Amount of 
Time Spent Watching Television Each Day 



1994 Trial Stale Assessment 


Georgia 


Southeast 


Nation 


How much television do you 


Percentage and Proficiency 


usually watch each day? 


*«-*,*«*». . ..... . 






One hour or less 


F:|f • '• - ’ ; .- 






1992 


SrlS 17(0 S)J<V : 


18(1.6) 


Sf-S T8 ( 0.8) <1; 




-214(a5)'|V a .^ 


; 21 ^ 8.0) ..... 


: f:J]:]v.219 ( 1.9) 


1994 


; 19(0.8) 


15(1.2) 


|;K:tV:-19(0.7) ^ 




.213(3.7) 


211 (2.9) 


iSS 21 7 ( 22) C / ; ;< 


Two hours 




i "1 • \ * '• 5 ; 


S 44 • ■ ; • •' t v . V ; 5/ 


1992 


' 19(0:8 


:-FT H9.(b.8) : • : '< ’ 


■V' : : 21 ( 0:9) : 






216(3.3) 


tlM 222 ( 


1994 


20 ( 0.9) 


,^F^?:'ri8;(i;6) 4 ', ; M 






217(2.8) 


214 ( 3.0) 


SSI 220 ( i,4) g|il;#=¥ 


Three hours 


illii 




/ v ! ~ ^ V,4 ;44 fc'^ % \ 


1992 


18(0.8) 


: 17(1.5) 


19(0.7) 




, 219{£3) 


6)444; 




1994 


§S 18(0.9) 




tUljMk’ 15 ( 0;5):^|tl|fv 




213(2.7) 


:> 216(2.5) h j?' 


J§fe ( p> ; 


Four to five hours 


■<f\J Si' 5 


, iff {>;: 


f '}/ * i Sf % *%"'('£ il| 


1992 


22(0.9) 






1994 


( 2 D : 


'vL213 ( 4.4): 4 ^w-vti'!.C 

24 ( 1.7) . 


§| ft If {21 5 : ( • l|5) : ||||||j| 

Sjf Jft '22 (: 0 . 8 )|| 6 ^ 




208 ( 2.5) 


211 (3.0) i 


tUIft (:L 8 )a|i |8 


Six hours or more 


%• *V ; ■ 4 :> ( • ; 


/ '--V, - : . CL 


i ;; ■=• " f 


1992 


25 (1.4) 


26(1.9) : 


21 ( 0.6) 








SS ,M98(Jl>7) lgS|§ 


1994 


|i|!^(^li3l 




|J ' 22 ( 0.7) |||' * H 




||f|fcl87 (3ip|f^ 


• 193 ( 3.1) 


Hf ^83 ( 1 - 8 )hS!lS| 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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APPENDIX A 



Procedural Appendix 

' X 'his appendix provides an overview of the technical details of the 1994 Trial 
State Assessment Program in reading. It includes a discussion of the history of NAEP, 
the assessment design, the reading framework and objectives upon which the assessment 
was based, and the procedures used to analyze the results. 

A Recent History of NAEP 

The National Assessment of Educational Progress (NAEP) is a congressionally 
mandated project of the National Center for Education Statistics (NCES) that has 
collected and reported information since 1969 on what American students know and 
what they can do. It is the nation’s only ongoing, comparable, and representative 
assessment of student achievement. Its assessments are given to representative samples 
of youths attending both public and non-public schools and enrolled in grades 4, 8, 
and 12. 

In 1988, Congress authorized a new aspect of NAEP that allowed states and 
territories to participate voluntarily in a trial state assessment, using samples 
representative of their own students, to provide state-level data comparable to the nation 
and each of the other participating jurisdictions. Pursuant to that law, in 1990, the 
mathematics achievement of public school eighth graders was assessed in 40 
jurisdictions (states, territories, and the District of Columbia). The results were reported 
in The State of Mathematics Achievement: NAEP’s 1990 Assessment of the Nation and 
the Trial Assessment of the States (Washington, DC: National Center for Education 
Statistics, 1991). In 1992, the mathematics achievement of fourth- and eighth-grade 
public school students and the reading achievement of fourth-grade public school 
students were assessed in 44 jurisdictions. The results of these assessments were 
reported in NAEP 1992 Mathematics Report Card for the Nation and the States 
(Washington, DC: National Center for Education Statistics, 1993) and NAEP 1992 
Reading Report Card for the Nation and the States (Washington, DC: National Center 
for Education Statistics, 1993). 
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For the 1994 Trial State Assessment Program, the reading achievement of 
fourth-grade students was again assessed in 44 jurisdictions. Forty jurisdictions involved 
in the 1992 assessment were also involved in the 1994 assessment. The results for 
Georgia are reported in this document. 

A difference between the 1994 Trial State Assessment and previous Trial State 
Assessments is the addition of samples of non-public school students, in addition to the 
public school student samples. The purpose of this addition is to provide overall 
state-level data for each jurisdiction that is more easily comparable to overall state-level 
data for the other participating jurisdictions. 

Over time there have been many changes in emphasis of NAEP assessment and 
reporting, both to take advantage of new technologies and to reflect changing trends in 
education. In 1984, a new technology called Item Response Theory (IRT) made it 
possible to create “scale scores” for NAEP similar to those the public was accustomed 
to seeing for the annual Scholastic Achievement Test (SAT). The 1992 reading reports 
marked NCES’s continued attempt to shift to standards -based reporting. The transition 
was made to report NAEP results by “achievement levels.” Achievement levels describe 
how students should perform relative to a body of content reflected in the NAEP 
frameworks (i.e., how much students should know). The impetus for this shift was 
grounded in the belief that NAEP data would take on more meaning for the public if they 
show what proportion of our youth are able to meet standards of performance necessary 
for a changing world. The 1994 report continues to use the achievement levels initially 
implemented in 1992. 

Assessment Content 

The objectives for the 1992 and 1994 assessments were developed through a 
consensus process managed by the Council of Chief State School Officers, and the items 
were developed through a similar process managed by Educational Testing Service. The 
development of the Trial State Assessment Program benefitted from the involvement of 
hundreds of representatives from State Education Agencies who attended numerous 
NETWORK meetings; served on committees; reviewed the framework, objectives, and 
questions; and, in general, provided important suggestions on all aspects of the program. 

The reading assessment framework was a four-by-three matrix specifying four 
reading stances — Initial Understanding, Developing an Interpretation, Personal 
Reflection and Response, and Demonstrating a Critical Stance — and three reading 
purposes — reading for literary experience, reading to be informed, and reading to 
perform a task. However, the reading to perform a task category was not evaluated or 
reported for grade 4. Figures A.l and A.2 describe the reading purposes and stances. 
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FIGURE A.1 

Description of Reading Purposes 



Reading involves an interaction between a specific type of text or written material and 
a reader who has a purpose for reading that is related to the type of text and the context 
of the reading situation. The 1992 and 1994 NAEP reading assessments presented three 
types of text to students representing each of three reading purposes: literary text for 
literary experience, informational text to gain information, and documents to perform a 
task. At grade 4, only the first two reading purposes were assessed. Each block in the 
assessment contains questions that assess only one reading purpose. 



Reading for Literary Experience 



Reading for literary experience involves reading literary text to explore the human 
condition, to relate narrative events with personal experience, and to consider the 
interplay in the selection among emotions, events, and possibilities. Students in the 
NAEP reading assessment were provided with a wide variety of literary texts such as 
short stories, poems, fables, historical fiction, science fiction, and mysteries. 



Reading to Gain Information 



Reading to gain information involves reading informative passages in order to obtain 
some general or specific information. This often requires a more utilitarian approach 
to reading that requires the use of certain reading/thinking strategies different from 
those used for other purposes. In addition, reading to gain information often involves 
reading and interpreting adjunct aids such as charts, graphs, maps, and tables that 
provide supplemental or tangential data. Informational passages in the NAEP reading 
assessment included biographies, science articles, encyclopedia entries, primary and 
secondary historical accounts, and newspaper editorials. 



Reading to Perform a Task 



Reading to perform a task involves reading various types of materials for the purpose 
of applying the information or directions in completing a specific task. The reader’s 
purpose for gaining meaning extends beyond understanding the text to include the 
accomplishment of a certain activity. Documents requiring students in the NAEP 
reading assessment to perform a task included directions for creating a time capsule, 
instructions on how to write a letter to your Senator, a bus schedule, and a tax form. 
In 1992 and 1994, reading to perform a task was assessed only at grades 8 and 12. 




THE 1994 NAEP TRIAL STATE ASSESSMENT 



101 



Georgia 



THE NATION'S 
REPORT Ifvapp 
CARD ~ 



1994 Trial State Assessment 



rcaep 



FIGURE A.2 

Description of Reading Stances 



Readers interact with text in various ways as they use background knowledge and 
understanding of text to construct, extend, and examine meaning. The NAEP reading 
assessment framework specified four reading stances to be assessed that represent 
various interactions between readers and texts. These stances are not meant to describe 
a hierarchy of skills or abilities. Rather, they are intended to describe behaviors that 
readers at all developmental levels should exhibit. 

Initial Understanding 



Initial understanding requires a broad, preliminary construction of an understanding 
of the text. Questions testing this aspect ask the reader to provide an initial 
impression or unreflected understanding of what was read. In the 1992 and 1994 
NAEP reading assessments, the first question following a passage was usually one 
testing initial understanding. 



Developing an Interpretation 



Developing an interpretation requires the reader to go beyond the initial impression 
to develop a more complete understanding of what was read. Questions testing this 
aspect require a more specific understanding of the text and involve linking 
information across parts of the text as well as focusing on specific information. 



Personal Reflection and Response 



Personal response requires the reader to connect knowledge from the text more 
extensively with his or her own personal background knowledge and experience. The 
focus is on how the text relates to personal experience, and questions on this aspect 
ask the readers to reflect and respond from a personal perspective. For the 1 992 and 
1994 NAEP reading assessments, personal response questions were typically 
formatted as constructed-response items to allow for individual possibilities and varied 
responses. 



Demonstrating a Critical Stance 



Demonstrating a critical stance requires the reader to stand apart from the text, 
consider it, and judge it objectively. Questions on this aspect require the reader to 
perform a variety of tasks such as critical evaluation, comparing and contrasting, 
applications to practical tasks, and understanding the impact of such text features as 
irony, humor, and organization. These questions focus on the reader as critic and 
require reflection on and judgments about how the text is written. 
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Assessment Design 

The 1994 reading assessment was based on a focused balanced incomplete block 
(BIB) spiral matrix design — a design that enables broad coverage of reading content 
while minimizing the burden for any one student. The 1994 NAEP reading assessment 
for grades 4, 8, and 12 contained a total of 153 discrete constructed-response questions 

— 126 of which were short constructed-response (78 scored using a two-point scoring 
rubric and 48 using a three-point scoring rubric), and 27 of which were extended 
constructed-response questions (scored using a four-point scoring rubric). Some of the 
questions in the assessment were administered at more than one grade. Therefore, the 
sum of the number of questions administered at each grade does not equal the total 
number of questions in the assessment. 

At grade 4, 84 reading questions were developed for the national assessment, 
including 37 short constructed-response questions, eight extended constructed-response 
questions, and 39 multiple-choice questions. These same questions were administered 
to the Trial State Assessment samples of grade 4 students. A subset of the grade 4 
exercise pool consisted of questions that were previously administered in 1992. These 
“trend” questions made it possible to report the 1992 and 1994 results on a common 
scale. 

The first step in implementing the BIB design required selecting grade-appropriate 
passages and developing questions to assess the four reading stances specified in the 
framework. The questions were assembled into units called blocks , with each block 
designed to be completed in 25 or 50 minutes. At grade 4, eight blocks were designed; 
they required 25 minutes of student time for completion. The blocks were assembled 
into assessment booklets so that each booklet contained three background questionnaires 

— the first consisting of general background questions, the second comprising reading 
background questions, and the third containing questions about the students’ motivation 
to do well in the assessment — and two blocks of cognitive reading questions. The 
questions in the first section were read aloud to the students, usually taking about 10 
minutes to complete. Students were then given 50 minutes to complete two 25-minute 
blocks of reading questions, five minutes to complete the second background 
questionnaire, and three minutes to complete the third background questionnaire. Thus, 
the assessment required slightly over one hour of student time. 

In accordance with the BIB design, the blocks were assigned to the assessment 
booklets so that there were a total of 16 booklets at grade 4. Blocks of cognitive reading 
questions were paired with blocks assessing the same purpose for reading as well as 
blocks assessing other purposes. (Readers should refer to the 1994 NAEP State 
Technical Report for a more complete discussion of the BIB design.) The booklets were 
spiraled or interleaved in a systematic sequence so that each booklet appeared an 
appropriate number of times in the sample. The students within an assessment session 
were assigned booklets in the order in which the booklets were spiraled. Thus, students 
in any given session received a variety of different booklets and only a small number 
of students in the session received the same booklet. 
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Participation Guidelines 

Unless the overall participation rate is sufficiently high for a jurisdiction, there is 
a risk that the assessment results for that jurisdiction are subject to appreciable 
nonresponse bias. Moreover, even if the overall participation rate is high, there may 
be significant nonresponse bias if the nonparticipation that does occur is heavily 
concentrated among certain types of schools or students. The following guidelines 
concerning school and student participation rates in the Trial State Assessment Program 
were established to address four significant ways in which nonresponse bias could be 
introduced into the jurisdiction sample estimates. The conditions that will result in the 
publication of a jurisdiction’s results are presented below. Also presented below are the 
conditions that will result in a jurisdiction receiving a notation in the 1994 reports. Note 
that in order for a jurisdiction’s results to be published with no notations, that jurisdiction 
must satisfy all guidelines. 

Guidelines on the Publication of NAEP Results 



Guideline 1 — Publication of Public School Results 
A jurisdiction will have its public school results published in the 1994 
NAEP Reading Report Card if and only if its weighted participation rate 
for the initial sample of public schools is greater than or equal to 70 
percent. Similarly, a jurisdiction will receive a separate NAEP State 
Report if and only if its weighted participation rate for the initial sample 
of public schools is greater than or equal to 70 percent. 

Guideline 2 — Publication of Non-Public School Results 
A jurisdiction will have its non-public school results published in the 
1994 NAEP Reading Report Card if and only if its weighted 
participation rate for the initial sample of non-public schools is greater 
than or equal to 70 percent AND meets minimum sample size 
requirements. 1 A jurisdiction eligible to receive a separate NAEP State 
Report under guideline 1 will have its non-public school results included 
in that report if and only if that jurisdiction’s weighted participation rate 
for the initial sample of non-public schools is greater than or equal to 
70 percent AND meets minimum sample size requirements. If a 
jurisdiction meets guideline 2 but fails to meet guideline 1, a separate 
NAEP State Report will be produced containing only non-public school 
results. 

Guideline 3 — Publication of Combined Public and Non-Public 

School Results 

A jurisdiction will have its combined results published in the 1994 
NAEP Reading Report Card if and only if both guidelines 1 and 2 are 
satisfied. Similarly, a jurisdiction eligible to receive a separate NAEP 
State Report under guideline 1 will have its combined results included 
in that report if and only if guideline 2 is also met. 




Minimum sample size requirements for reporting non-public school data consist of two components: (1) a school 
sample size of six or more participating schools and (2) an assessed student sample size of at least 62. 
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Discussion: If a jurisdiction’s public or non-public school participation rate for 
the initial sample of schools is below 70 percent there is a substantial possibility that 
bias will be introduced into the assessment results. This possibility remains even after 
making statistical adjustments to compensate for school nonparticipation. There remains 
the likelihood that, in aggregate, the substitute schools are sufficiently dissimilar from 
the originals that they are replacing and represent too great a proportion of the 
population to discount such a difference. Similarly, the assumptions underlying the use 
of statistical adjustments to compensate for nonparticipation are likely to be significantly 
violated if the initial response rate falls below the 70 percent level. Guidelines 1, 2, 
and 3 take this into consideration. These guidelines are congruent with current NAGB 
policy, which requires that data for jurisdictions that do not have a 70 percent 
before-substitution participation rate be reported “in a different format” and with the 
Education Information Advisory Committee (EIAC) resolution, which calls for data from 
such jurisdictions not to be published. 

Guidelines on Notations of NAEP Results 



Guideline 4 — Notation for Overall Public School Participation Rate 
A jurisdiction which meets guideline 1 will receive a notation if its 
weighted participation rate for the initial sample of public schools was 
below 85 percent AND the weighted public school participation rate 
after substitution was below 90 percent. 

Guideline 5 — Notation for Overall Non-Public School Participation 

Rate 

A jurisdiction which meets guideline 2 will receive a notation if its 
weighted participation rate for the initial sample of non-public schools 
was below 85 percent AND the weighted non-public school participation 
rate after substitution was below 90 percent. 

Discussion: For jurisdictions that did not use substitute schools, the participation 
rates are based on participating schools from the original sample. In these situations, 
the NCES standards specify weighted school participation rates of at least 85 percent to 
guard against potential bias due to school nonresponse. Thus, the first part of these 
guidelines, referring to the weighted school participation rate for the initial sample of 
schools, is in direct accordance with NCES standards. 
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To help ensure adequate sample representation for each jurisdiction participating 
in the 1994 Trial State Assessment Program, NAEP provided substitutes for 
nonparticipating public and non-public schools. When possible, a substitute school was 
provided for each initially selected school that declined participation before November 
15, 1993. For jurisdictions that used substitute schools, the assessment results will be 
based on the student data from all schools participating from both the original sample 
and the list of substitutes (unless both an initial school and its substitute eventually 
participated, in which case only the data from the initial school will be used). 

The NCES standards do not explicitly address the use of substitute schools to 
replace initially selected schools that decide not to participate in the assessment. 
However, considerable technical consideration was given to this issue. Even though the 
characteristics of the substitute schools were matched as closely as possible to the 
characteristics of the initially selected schools, substitution does not entirely eliminate 
bias due to the nonparticipation of initially selected schools. Thus, for the weighted 
school participation rates including substitute schools, the guidelines were set at 90 
percent. 

If a jurisdiction meets either standard (i.e., 85 percent or higher prior to 
substitution or 90 percent or higher after substitution) then there will be no notation for 
the relevant overall school participation rate. 

Guideline 6 — Notation for Strata-Specific Public School Participation 

Rate 

A jurisdiction which is not already receiving a notation under 

guideline 4 will receive a notation if the nonparticipating public schools 

included a class of schools with similar characteristics, which together 
accounted for more than five percent of the jurisdiction’s total 

fourth-grade weighted sample of public schools. The classes of schools 
from each of which a jurisdiction needed minimum school participation 
levels were determined by degree of urbanization, minority enrollment, 
and median household income of the area in which the school is located. 

Guideline 7 — Notation for Strata-Specific Non-Public School 
Participation Rate 

A jurisdiction which is not already receiving a notation under 

guideline 5 will receive a notation if the nonparticipating non-public 
schools included a class of schools with similar characteristics, which 
together accounted for more than five percent of the jurisdiction’s total 
fourth-grade weighted sample of non-public schools. The classes of 
schools from each of which a jurisdiction needed minimum school 
participation levels were determined by type of non-public school 
(Catholic versus non-Catholic) and location (metropolitan versus 
non-metropolitan). 
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Discussion: The NCES standards specify that attention should be given to the 
representativeness of the sample coverage. Thus, if some important segment of the 
jurisdiction’s population is not adequately represented, it is of concern, regardless of the 
overall participation rate. 

These guidelines address the fact that, if nonparticipating schools are concentrated 
within a particular class of schools, the potential for substantial bias remains, even if the 
overall level of school participation appears to be satisfactory. Nonresponse adjustment 
cells for public schools have been formed within each jurisdiction, and the schools 
within each cell are similar with respect to minority enrollment, degree of urbanization, 
and/or median household income, as appropriate for each jurisdiction. For non-public 
schools, nonresponse adjustment cells are determined by type and location of school. 

If more than five percent (weighted) of the sampled schools (after substitution) 
are nonparticipants from a single adjustment cell, then the potential for nonresponse bias 
is too great. These guidelines are based on the NCES standard for strata-specific school 
nonresponse rates. 

Guideline 8 — Notation for Overall Student Participation Rate in 

Public Schools 

A jurisdiction which meets guideline 1 will receive a notation if the 
weighted student response rate within participating public schools was 
below 85 percent. 

Guideline 9 — Notation for Overall Student Participation Rate in 
Non-Public Schools 

A jurisdiction which meets guideline 2 will receive a notation if the 
weighted student response rate within participating non-public schools 
was below 85 percent. 

Discussion: These guidelines follow the NCES standard of 85 percent for overall 
student participation rates. The weighted student participation rate is based on all 
eligible students from initially selected or substitute schools who participated in the 
assessment in either an initial session or a make-up session. If the rate falls below 
85 percent, then the potential for bias due to students’ nonresponse is too great. 

Guideline 10 — Notation for Strata-Specific Student Participation 
Rate in Public Schools 

A jurisdiction which is not already receiving a notation under 
guideline 8 will receive a notation if the nonresponding students within 
participating public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable public school student sample. Student 
groups from which a jurisdiction needed minimum levels of participation 
were determined by age of student and type of assessment session 
(unmonitored or monitored), as well as school level of urbanization, 
minority enrollment, and median household income of the area in which 
the school is located. 
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Guideline 11 — Notation for Strata- Specific Student Participation 
Rate in Non-Public Schools 

A jurisdiction which is not already receiving a notation under 
guideline 9 will receive a notation if the nonresponding students within 
participating non-public schools included a class of students with similar 
characteristics, who together comprised more than five percent of the 
jurisdiction’s weighted assessable non-public school student sample. 

Student groups from which a jurisdiction needed minimum levels of 
participation were determined by age of student and type of assessment 
session (unmonitored or monitored), as well as type and location of 
school. 

Discussion: These guidelines address the fact that if nonparticipating students are 
concentrated within a particular class of students, the potential for substantial bias 
remains, even if the overall student participation level appears to be satisfactory. Student 
nonresponse adjustment cells have been formed using the school-level nonresponse 
adjustment cells, together with the student’s age and the nature of the assessment session 
(unmonitored or monitored). If more than five percent (weighted) of the invited students 
who do not participate in the assessment are from a single adjustment cell, then the 
potential for nonresponse bias is too great. These guidelines are based on the NCES 
standard for strata-specific student nonresponse rates. 

Data Analysis and Scales 

Once the assessments were conducted and information from the assessment 
booklets had been compiled in a database, the assessment data were weighted to match 
known population proportions and adjusted for nonresponse. Analyses were then 
conducted to determine the percentages of students who gave various responses to each 
cognitive and background question. 

For both the 1992 and 1994 assessments, item response theory (IRT) was used to 
estimate average reading proficiency for each jurisdiction and for various 
subpopulations, based on students’ performance on the set of reading questions they 
received. IRT provides a common scale on which performance can be reported for the 
nation, each jurisdiction, and subpopulations, even when all students do not answer the 
same set of questions. Furthermore, these IRT scales provide a mechanism for 
comparing the reading results obtained in 1994 with those from 1992 even though there 
were some differences between the sets of questions that were administered in the two 
assessment years. This common scale makes it possible to report on relationships 
between students’ characteristics (based on their responses to the background questions) 
and their overall performance on the assessment. 
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The results from the 1994 assessment are reported on scales ranging from 0 to 500 
that were created to summarize performance for each of the two reading purposes at 
grade 4 (reading for literary experience and reading to gain information). The scales 
summarize examinee performance across all four question types used in the assessment 
(multiple-choice, dichotomously-scored constructed-response, regular 
constructed-response, and extended constructed-response). In producing the scales, three 
distinct IRT models were used. Multiple-choice questions were scaled using the 
three-parameter logistic model; dichotomously-scored constructed-response questions 
were scaled using the two-parameter logistic model; the regular and extended 
constructed-response questions were scaled using a generalized partial-credit model. 
Each reading purpose scale was based on the distribution of student performance across 
the grades assessed in the 1992 national assessment (grades 4, 8, and 12) and had a mean 
of 250 and a standard deviation of 50 for that reference population. A composite scale 
was created as an overall measure of students’ reading proficiency. At grade 4, the 
composite scale was a weighted average of the two reading purpose scales, where the 
weight for each reading purpose was proportional to the relative importance assigned to 
that purpose in the specifications developed by the Reading Objectives Panel (55 percent 
for the literary experience scale and 45 percent for the gaining information scale). 

Questionnaires for Teachers and Schools 

As part of the Trial State Assessment Program, questionnaires were given to the 
reading teachers of assessed students and to the principal or other administrator in each 
participating school. A Background Panel drafted a set of issues and guidelines and 
made recommendations concerning the design of these questionnaires. For the 1992 and 
1994 assessments, the teacher and school questionnaires focused on five educational 
areas: instructional content, instructional practices and experiences, teacher 
characteristics, school conditions and context, and conditions beyond school (i.e., home 
support, out-of-school activities, and attitudes). Similar to the development of the 
materials given to students, the guidelines and the teacher and school questionnaires 
were prepared through an iterative process that involved extensive development, field 
testing, and review by external advisory groups. 

It is important to note that in this report, as in all NAEP reports, the student is 
always the unit of analysis, even when information from the teacher or school 
questionnaire is being reported. Having the student as the unit of analysis makes it 
possible to describe the instruction received by representative samples of fourth-grade 
students. Although this approach may provide a different perspective from that which 
would be obtained by simply collecting information from a sample of fourth-grade 
reading teachers or from a sample of schools, it is consistent with NAEP’s goal of 
providing information about the educational context and performance of students. 
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The questionnaires for fourth-grade teachers consisted of two parts. The first 
requested information about the teacher, such as race/ethnicity and gender, as well as 
academic degrees held, teaching certification, training in reading, and the availability 
of instructional resources. In the second part, teachers were asked to provide 
information on each class they taught that included one or more students who 
participated in the Trial State Assessment Program. The information included, among 
other things, the extent to which worksheets or workbooks were used and the frequency 
with which various instructional approaches were employed. Because of the nature of 
the sampling for the Trial State Assessment Program, the responses to the reading 
teacher questionnaire do not necessarily represent all fourth-grade reading teachers in a 
jurisdiction. Rather, they represent the teachers of the particular students being assessed. 

An extensive school questionnaire was completed by principals or other 
administrators in the schools participating in the Trial State Assessment Program. The 
school questionnaire contained questions about school policies, course offerings, and 
special priority areas, among other topics. 

Estimating Variability 

The statistics reported by NAEP (average proficiencies, percentages of students 
at or above particular achievement levels, and percentages of students responding in 
certain ways to background questions) are estimates of the corresponding information 
for the population of fourth-grade students in public or non-public schools in a 
jurisdiction. These estimates are based on the performance of carefully selected, 
representative samples of fourth-grade students from the jurisdiction. 

If a different representative sample of students were selected and the assessment 
repeated, it is likely that the estimates might vary somewhat, and both of these sample 
estimates might differ somewhat from the value of the mean or percentage that would 
be obtained if every fourth-grade public or non-public school student in the jurisdiction 
were assessed. Virtually all statistics that are based on samples (including those in 
NAEP) are subject to a certain degree of uncertainty. The uncertainty attributable to 
using samples of students is referred to as sampling error . 

Like almost all estimates based on assessment measures, NAEP’s total group and 
subgroup performance estimates are subject to a second source of uncertainty, in addition 
to sampling error. As previously noted, each student who participated in the Trial State 
Assessment Program was administered a subset of questions from the total set of 
questions. If each student had been administered a different, but equally appropriate, 
set of the assessment questions — or the entire set of questions — somewhat different 
estimates of total group and subgroup performance might have been obtained. Thus, a 
second source of uncertainty arises because each student was administered a subset of 
the total pool of questions. 
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The measures of uncertainty of the estimates of reading performance statistics 
reflect both sources of uncertainty discussed above. These measures of the uncertainty 
are called standard errors and are given in parentheses in each of the tables in the report. 
Standard errors reflecting both sampling and measurement error are reported for 
estimates of average proficiency and percentage of students at or above particular 
achievement levels. The standard errors of the other statistics (such as the percentage 
of students answering a background question in a certain way or the percentage of 
students in certain racial/ethnic groups) reflect only sampling error. NAEP uses a 
methodology called the jackknife procedure to estimate all of these standard errors. 

The reader is reminded that, as in all surveys, NAEP results are also subject to 
other kinds of errors including the effects of necessarily imperfect adjustment for student 
and school nonresponse and other largely unknowable effects associated with the 
particular instrumentation and data collection methods used. Nonsampling errors can 
be attributed to a number of sources: inability to obtain complete information about all 
selected students in all selected schools in the sample (some students or schools refused 
to participate, or students participated but answered only certain questions); ambiguous 
definitions; differences in interpreting questions; inability or unwillingness to give 
correct information; mistakes in recording, coding, or scoring data; and other errors of 
collecting, processing, sampling, and estimating missing data. The extent of 
nonsampling errors is difficult to estimate. By their nature, the impact of such errors 
cannot be reflected in the data-based estimates of uncertainty provided in NAEP reports. 

Drawing Inferences from the Results 

One of the goals of the Trial State Assessment Program is to make inferences 
about the overall population of fourth-grade students in each participating jurisdiction 
based on the particular sample of students assessed. The results from the sample — 
taking into account the uncertainty associated with all samples — are used to make 
inferences about the population. The use of confidence intervals, based on the standard 
errors, provides a way to make inferences about the population means and percentages 
in a manner that reflects the uncertainty associated with the sample estimates. An 
estimated sample mean proficiency ± 2 standard errors approximates a 95 percent 
confidence interval for the corresponding population quantity. This means that with 
approximately 95 percent confidence, the average performance of the entire population 
of interest (e.g., all fourth-grade students in public schools in a jurisdiction) is within ± 
2 standard errors of the sample mean. 
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As an example, suppose that the average reading proficiency of the students in a 
particular jurisdiction’s fourth-grade sample were 256 with a standard error of 1.2. A 
95 percent confidence interval for the population quantity would be as follows: 

Mean ± 2 standard errors = 256 ± 2 x (1.2) = 256 ± 2.4 = 

256 - 2.4 and 256 + 2.4 = (253.6, 258.4) 

Thus, one can conclude with 95 percent confidence that the average proficiency 
for the entire population of fourth-grade students in public schools in that jurisdiction 
is between 253.6 and 258.4. 

Similar confidence intervals can be constructed for percentages, provided that the 
percentages are not extremely large (greater than 90 percent ) or extremely small (less 
than JO percent). For extreme percentages, confidence intervals constructed in the above 
manner may not be appropriate and procedures for obtaining accurate confidence 
intervals are quite complicated. 

Analyzing Subgroup Differences in Proficiencies and Percentages 

In addition to the overall results, this report presents outcomes separately for a 
variety of important subgroups. Many of these subgroups are defined by shared 
characteristics of students, such as their gender or race/ethnicity, and the type of location 
in which their school is situated. Other subgroups are defined by students’ responses 
to background questions. Still other subgroups are defined by the responses of the 
assessed students’ reading teachers to questions in the reading teacher questionnaire. 

In Chapter 1 of this report, differences between the jurisdiction and nation were 
tested for overall reading proficiency and for each of the purposes for reading. In 
Chapter 2, significance tests were conducted for the overall proficiency for each of the 
subpopulations. Chapter 3 reports differences between the jurisdiction and nation for 
the percentage of students at or above the Proficient level, and Chapter 4 contains 
significance tests for the percentage of students at or above the Proficient level for each 
of the subpopulations. In Chapters 5-8, comparisons were made across subgroups for 
responses made to various background questions. 
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As an example, consider the question: Do students who reported reading three 
or four books outside of school each month exhibit higher average reading proficiency 
than students who reported reading no books outside of school? 

To answer the question posed above, begin by comparing the average reading 
proficiency for the two groups being analyzed. If the mean for the group that reported 
reading three or four books outside of school is higher, it may be tempting to conclude 
that that group does have higher reading proficiency than the group that reported reading 
no books outside of school. However, even though the means differ, there may be no 
real difference in performance between the two groups in the population because of the 
uncertainty associated with the estimated average proficiency of the groups in the 
sample. Remember that the intent is to make a statement about the entire population, 
not about the particular sample that was assessed. The data from the sample are used 
to make inferences about the population as a whole. 

As discussed in the previous section, each estimated sample mean proficiency (or 
percentage) has a degree of uncertainty associated with it. It is therefore possible that 
if all students in the population had been assessed, rather than a sample of students, or 
if the assessment had been repeated with a different sample of students or a different, 
but equivalent, set of questions, the performances of various groups would have been 
different. Thus, to determine whether there is a real difference between the mean 
proficiency (or percentage of a certain attribute) for two groups in the population, an 
estimate of the degree of uncertainty associated with the difference between the 
proficiency means or percentages of those groups must be obtained for the sample. This 
estimate of the degree of uncertainty — called the standard error of the difference 
between the groups — is obtained by taking the square of each group’s standard error, 
summing these squared standard errors, and then taking the square root of this sum. 

Similar to the manner in which the standard error for an individual group mean 
or percentage is used, the standard error of the difference can be used to help determine 
whether differences between groups in the population are real. The difference between 
the mean proficiency or percentage of the two groups ± 2 standard errors of the 
difference represents an approximate 95 percent confidence interval. If the resulting 
interval includes zero, there is insufficient evidence to claim a real difference between 
groups in the population. If the interval does not contain zero, the difference between 
groups is statistically significant (different) at the .05 level. 
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As another example, to determine whether the average reading proficiency of 
fourth-grade females is higher than that of fourth-grade males in a particular 
jurisdiction’s public schools, suppose that the sample estimates of the mean proficiencies 
and standard errors for females and males were as follows: 



Group 


Average Proficiency 


Standard Error 


Female 


259 


2.0 


Male 


255 


2.1 



The difference between the estimates of the mean proficiencies of females and 
males is four points (259 - 255). The standard error of this difference is 



V 2.0 2 + 2.1 2 =2.9 

Thus, an approximate 95 percent confidence interval for this difference is 
Mean difference ± 2 standard errors of the difference = 

4 ± 2 x (2.9) = 4 ± 5.8 = 4 - 5.8 and 4 + 5.8 = (-1.8, 9.8) 

The value zero is within this confidence interval, which extends from -1.8 to 9.8 
(i.e., zero is between -1.8 and 9.8). Thus, there is insufficient evidence to claim a 
difference in average reading proficiency between the populations of fourth-grade 
females and males in public schools in the jurisdiction. 2 

Throughout this report, when the mean proficiencies or percentages for two groups 
were compared, procedures like the one described above were used to draw the 
conclusions that are presented. If a statement appears in the report indicating that a 
particular group had higher (or lower) average proficiency than a second group, the 95 
percent confidence interval for the difference between groups did not contain zero. 
When a statement indicates that the average proficiency or percentage of some attribute 
was not significantly different for two groups, the confidence interval included zero, and 
thus no difference could be assumed between the groups. The information described in 
this section also pertains to comparisons between 1992 and 1994. The reader is 
cautioned to avoid drawing conclusions solely on the basis of the magnitude of the 
differences. A difference between two groups in the sample that appears to be slight 
may represent a statistically significant difference in the population because of the 
magnitude of the standard errors. Conversely, a difference that appears to be large may 
not be statistically significant. 



O 

ERIC 



The procedure described above (especially the estimation of the standard error of the difference) is, in a strict sense, 
only appropriate when the statistics being compared come from independent samples. For certain comparisons in the 
report, the groups were not independent. In those cases, a different (and more appropriate) estimate of the standard 
error of the difference was used. 
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The procedures described in this section, and the certainty ascribed to intervals 
(e.g., a 95 percent confidence interval), are based on statistical theory that assumes that 
only one confidence interval or test of statistical significance is being performed. 
However, in each chapter of this report, many different groups are being compared (i.e., 
multiple sets of confidence intervals are being analyzed). In sets of confidence intervals, 
statistical theory indicates that the certainty associated with the entire set of intervals is 
less than that attributable to each individual comparison from the set. To hold the 
certainty level for the set of comparisons at a particular level (e.g., .95), adjustments 
(called multiple comparison procedures) must be made to the methods described in the 
previous section. One such procedure — the Bonferroni method — was used in the 
analyses described in this report to form confidence intervals for the differences between 
groups whenever sets of comparisons were considered. Thus, the confidence intervals 
in the text that are based on sets of comparisons are more conservative than those 
described on the previous pages. A more detailed description of the use of the 
Bonferroni procedure appears in the 1994 NAEP State Technical Report. 

Statistics with Poorly Estimated Standard Errors 

The standard errors for means and proportions reported by NAEP are statistics and 
therefore are subject to a certain degree of uncertainty. In certain cases, typically when 
the standard error is based on a small number of students, or when the group of students 
is enrolled in a small number of schools, the amount of uncertainty associated with the 
standard errors may be quite large. Throughout this report, estimates of standard errors 
subject to a large degree of uncertainty are followed by the symbol In such cases, 
the standard errors — and any confidence intervals or significance tests involving these 
standard errors — should be interpreted cautiously. Further details concerning procedures 
for identifying such standard errors are discussed in the 1994 NAEP State Technical 
Report. 

Minimum Subgroup Sample Sizes 

Results for reading performance and background variables were tabulated and 
reported for groups defined by race/ethnicity, type of location, parents’ education level, 
and gender. NAEP collects data for six racial/ethnic subgroups (White, Black, Hispanic, 
Asian, Pacific Islander, and American Indian/Alaskan Native), three types of locations 
(Central City, Urban Fringe/Large Town, and Rural/Small Town), and five levels of 
parents’ education (Graduated College, Some Education After High School, Graduated 
High School, Did Not Finish High School, and I Don’t Know). In the past, NAEP 
collected information for only five racial/ethnic subgroups, with Asian and Pacific 
Islander students combined into one subgroup. In addition, previous NAEP reports 
reported data for four types of communities, rather than for the three types of location. 
These types of communities were Advantaged Urban, Disadvantaged Urban, Extreme 
Rural, and Other types of communities. 
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In many jurisdictions, and for some regions of the country, the number of students 
in some of these groups was not sufficiently high to permit accurate estimation of 
performance and/or background variable results. As a result, data are not provided for 
the subgroups with very small sample sizes or for the subgroups with students from very 
few schools. For results to be reported for any Trial State Assessment Program 
subgroup, at least ten public schools or six non-public schools must be represented in 
the subgroup. For results to be reported for any National Assessment subgroup, at least 
five primary sampling units (PSU’s) must be represented in the subgroup. In addition, 
a minimum sample of 62 students per subgroup was required. For statistical tests 
pertaining to subgroups, the sample size for both groups had to meet the minimum 
sample size requirements. 

The minimum sample size of 62 was determined by computing the sample size 
required to detect an effect size of .5 total-group standard deviation units with a 
probability of .8 or greater. The effect size of .5 pertains to the true difference between 
the average proficiency of the subgroup in question and the average proficiency for the 
total fourth-grade public school population in the jurisdiction, divided by the standard 
deviation of the proficiency in the total population. If the true difference between 
subgroup and total group mean is .5 total-group standard deviation units, then a sample 
size of at least 62 is required to detect such a difference with a probability of .8. Further 
details about the procedure for determining minimum sample size appear in the 1994 
NAEP State Technical Report. 

Describing the Size of Percentages 

Some of the percentages reported in the text of the report are given qualitative 
descriptions. For example, the number of students being taught by teachers with 
master’s degrees in education might be described as “relatively few” or “almost all,” 
depending on the size of the percentage in question. Any convention for choosing 
descriptive terms for the magnitude of percentages is to some degree arbitrary. The 
descriptive phrases used in the report and the rules used to select them are shown on the 
following page. 
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Percentage 


Description of Text in Report 


P = o 


None 


0 < p < 8 


A small percentage 


8 < p < 13 


Relatively few 


13 < p < 18 


Less than one fifth 


18 < p < 22 


About one fifth 


22 < p < 27 


About one quarter 


27 < p < 30 


Less than one third 


30 < p < 36 


About one third 


36 < p < 47 


Less than half 


47 < p < 53 


About half 


53 < p < 64 


More than half 


64 < p < 71 


About two thirds 


71 < p < 79 


About three quarters 


79 < p < 89 


A large majority 


89 < p < 1 00 


Almost all 


p = 100 


Ail 



Changes to Student. Teacher, and School Questionnaire Items Between 1992 and 
1994 

As described in Part Three of this report, some of the questions asked of students, 
teachers, and schools in 1992 about students’ instructional experiences were either 
reformatted and/or reworded for the 1994 assessment. Although this allowed for more 
precise and relevant data collection, it was not possible to report trend results on those 
particular questions. Furthermore, some questions were reworded substantially so as to 
warrant the reporting of only 1994 results. This section describes the nature of the 
changes that precluded making trend comparisons, and in some cases precluded 
reporting the 1992 results. Also, the specific questionnaire items reported in this 
publication that were reformatted and/or reworded are identified. 

Questions for which 1992 and 1994 results are reported, but trend comparisons 
are not made. One change between the 1992 and 1994 teacher questionnaires at grade 
4 was the reformatting of questions from a five-column response format to a single 
question format. With the five-column format used in 1992, teachers were asked to 
identify in which period or periods (of up to 5 class periods) they taught students who 
participated in the NAEP reading assessment. They were then asked to describe the 
instructional approaches they used for each class period in which they had a student 
taking part in the assessment. This allowed teachers to describe different instructional 
approaches that may have been used for up to 5 different reading classes, if in fact their 
approach varied across groups of students. For 1994, the teacher questionnaire was 
revised so that teachers were only asked to respond once to each question in terms of 
their typical approach, or the one they use most often with all of their students. This 
change was made in the grade 4 teacher questionnaire out of recognition that most 
teachers at this level teach self-contained classes. 
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Although in most cases, the wording did not change or changed minimally, it was 
determined that the reformatting of the questionnaires and the refocusing of teachers’ 
responses from specific approaches for individual class periods to typical approaches 
across classes, constituted enough change to preclude comparing responses between the 
two assessments. Because the wording changes were minimal, data are reported from 
both assessments — but trend comparisons were not conducted. Of the items reported 
in this publication, the following were either reformatted or were reworded minimally: 



1992 Version 

Has your school identified any of the 
following subjects as a priority in the last 
two years ( i.e ., does the subject receive 
special emphasis in schoolwide goals and 
objectives, instruction, in-service training , 
etc.)? 

• Reading 

• Writing 

• Mathematics 

• Integration of separate subjects 

(five-column formatting) 

Are students assigned to this class 
by ability? 

• Yes 

• No 

(five-column formatting) 

About how much time do you spend with 
this class for reading instruction on a 
typical day ? 

• 30 minutes 

• 45 minutes 

• 60 minutes 

• 90 minutes or more 



1994 Version 

Has your school identified any of the 
following subjects as a priority in the last 
two years (i.e. y does the subject receive 
special emphasis in schoolwide goals and 
objectives, instruction, workshops, etc.)? 

• Reading 

• Mathematics 

• Science 

• U.S. history 

• World geography 

• Integration of separate subjects 

(single-column formatting) 

Are students assigned to this class 
by ability? 

• Yes 

• No 

(single-column formatting) 

About how much time do you spend with 
this class for reading instruction on a 
typical day? 

• 30 minutes 

• 45 minutes 

• 60 minutes 

• 90 minutes or more 
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(five-column formatting) 

What type of materials form the core of 
your reading program? 

• Primarily basal 

• Primarily trade books 

• Both basal and trade books 

• Other 

(five-column formatting) 

How often do you [teacher] use the 
following resources to teach reading 
in this class? 

• Children’s newspapers and/or magazines 

• Reading kits 

• Computer software for reading instruction 

• A variety of books (e.g., novels, 
collections of poetry, nonfiction) 

• Materials from other subject areas 

(five-column formatting) 

How often do you [teacher] do the following 
things as a part of reading instruction with 
this class ? 

• Ask students to work in a reading 
workbook or on a worksheet 

• Ask students to write about something 
they have read 

• Discuss new or difficult vocabulary 

• Ask students to talk with each other 
about what they have read 

• Ask students to do a group activity or 
project about what they have read 

• Ask students to read aloud 

• Ask students to read silently 

When you [student] read in school , how 
often does your teacher do each of 
the following? 

• Ask you to read silently 

• Give you time to read books you 
have chosen yourself 



(single-column formatting) 

What type of materials form the core of 
your reading program? 

• Primarily basal 

• Primarily trade books 

• Both basal and trade books 

• Other 

(single-column formatting) 

How often do you [teacher] use the 
following resources to teach reading 
in this class? 

• Children’s newspapers and/or magazines 

• Reading kits 

• Computer software for reading instruction 

• A variety of books (e.g., novels, 
collections of poetry, nonfiction) 

• Materials from other subject areas 

(single-column formatting) 

How often do you [teacher] do the following 
things as a part of reading instruction with 
this class? 

• Ask students to work in a reading 
workbook or on a worksheet 

• Ask students to write about something 
they have read 

• Discuss new or difficult vocabulary 

• Ask students to talk with each other 
about what they have read 

• Ask students to do a group activity or 
project about what they have read 

• Ask students to read aloud 

• Ask students to read silently 

When you [student] have reading assignments 
in school, how often does your teacher do each 
of the following ? 

• Ask you to read silently 

• Give you time to read books you 
have chosen yourself 
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(five-column formatting) 

How often do you [teacher] do each of the 
following with the students in this class? 

• Send or take the class to the library 

• Assign students to read a book from 
the library 

(five-column formatting) 

How often do you use each of the following 
to assess student progress in reading ? 

• Multiple-choice tests 

• Reading portfolios 

During the last year , how much time in 
total have you spent on in-service education 
in reading or the teaching of reading? 
Include attendance at professional meetings 
and conferences , workshops , and courses. 

• None 

• Less than 6 hours 

• 6-15 hours 

• 16-35 hours 

• More than 35 hours 



(single-column formatting) 

How often do you [teacher] do each of the 
following with the students in this class? 

• Send or take the class to the library 

• Assign students to read a book from 
the library 

(single-column formatting) 

How often do you use each of the following 
to assess student progress in reading ? 

• Multiple-choice tests 

• Reading portfolios 

During the last year , how much time in 
total have you spent in staff development 
workshops or seminars in reading or the 
teaching of reading? Include attendance at 
professional meetings and conferences , 
workshops , and college or university courses. 

• None 

• Less than 6 hours 

• 6-15 hours 

• 16-35 hours 

• More than 35 hours 



Questions for which only 1994 results are presented. In other cases, the actual 
wording of the item was changed sufficiently to preclude trend reporting. Because of 
the substantial wording changes, 1992 results for these questions are not presented in this 
report. Of the items reported in this publication, the following were reworded 
substantially between 1992 and 1994. 
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1992 Version 1994 Version 

When you [student] read in school , how often When you [student] have reading 
does your teacher do each of the following? assignments in school , how often does 



• Ask students to talk to each other about 
what they have read 

• Ask students to do a group activity or 
project about what they have read 

• Ask students to read aloud 


your teacher do each of the following? 

• Ask you to talk to other students about 
what you have read 

• Ask you to do a group activity or project 
about what you have read 

• Ask you to read aloud 


(five-column formatting) 


(single-column formatting) 



How often do you [teacher] do the following How often do you [teacher] do the following 
things as a part of reading instruction with things as a part of reading instruction with 



this class? 

• Provide time to have students read 
books of their own choosing 


this class? 

• Give students time to read books they 
have chosen themselves 


(five-column formatting) 

How often do you [teacher] do each of 
the following to assess student progress 
in reading? 

• Writing paragraphs about what 
they have read 


(single-column formatting) 

How often do you [teacher] do each of 
the following to assess student progress 
in reading? 

• Paragraph length written responses about 
what students have read 


What is the highest academic degree 
you [teacher] hold? 

• Less than a bachelor’s degree 

• Bachelor’s degree 

• Master’s degree 

• Educational specialist’s or professional 
diploma based on at least one year’s work 
past master’s degree 

• Doctorate 

• Professional degree (e.g., M.D., LL.B., 
J.D., D.D.S.) 


What is the highest academic degree 
you [teacher] hold? 

• High-school diploma 

• Associate’s degree/vocational certification 

• Bachelor’s degree 

• Master’s degree 

• Education specialist’s or professional 
diploma based on at least one year’s work 
past master’s degree 

• Doctorate 

• Professional degree (e.g., M.D., LL.B., 
J.D., D.D.S.) 
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What type of teaching certification do 
you [teacher] have that is recognized 
by the state in which you teach? 

• None, temporary, probational, provisional, 
or emergency certification 

• Regular certification but lower than the 
highest available certification 

• The highest certification available 



What were your undergraduate major 
fields of study? 

• Education 

• English, reading, and/or language arts 

• Mathematics 

• Mathematics education 

• Other 



What were your graduate major 
fields of study? 

• Education 

• English, reading and/or language arts 

• Mathematics 

• Mathematics education 

• Other 

• No graduate-level study 



What type of teaching certification do 
you [teacher] have that is recognized 
by the state in which you teach? 

• None 

• Temporary, probational, provisional, 
or emergency certification 

• Regular certification but less than the 
highest available 

• The highest certification available 
(permanent or long term) 

What were your undergraduate major 
fields of study? 

• Education 

• English 

• Reading and/or language arts 

• Geography 

• History 

• Social Studies education 

• Other 

What were your graduate major 
fields of study? 

• Education 

• English 

• Reading and/or language arts 

• Geography 

• History 

• Social Studies education' 

• Other 

• No graduate-level study 



Revisions to the 1992 and 1994 Findings 

In April 1995, results from the 1994 National and Trial State Assessment of 
reading were released as part of the report NAEP 1994 Reading: A First Look. 
Subsequently, ETS/NAEP discovered an error in the documentation for the ETS program 
used to compute NAEP scale score results. The error affected how omitted responses 
were treated in the IRT scaling of the extended constructed-response questions that 
received partial-credit scoring. The error affected only those questions; omitted 
multiple-choice and omitted short constructed responses were treated appropriately. 
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The conventional treatment in NAEP subjects has been to treat omitted responses 
(blank responses to a question that are followed by valid responses to questions that 
appear later in the block) as the lowest possible score category in the production of 
NAEP scale scores. In contrast, not-reached responses (blank responses that are not 
followed by any further student responses) are treated as missing data. As a result of 
the documentation error, for a number of the polytomous constructed-response questions 
and across several subject areas, all blank responses (both omitted and not-reached 
responses) to affected questions were treated as missing — an acceptable treatment but 
not the conventional option of choice for NAEP. 

The error affected a number of the NAEP scales constructed since 1992. 
Specifically, the 1992 and 1994 national and state reading results were affected by the 
error. Results from these two assessments have been released to the public in a number 
of NAEP publications. The 1992 data are also available to the public through NCES's 
secondary-use data files. 

It should be noted that this processing error also impacted the location of the 
National Assessment Governing Board (NAGB) achievement levels in reading, which 
were set on the 1992 scales. 

NCES and ETS felt that the most technically correct plan of action would be to 
recalculate all affected NAEP scales, no matter how slight the change, and to issue 
revised results. ETS was therefore instructed by NCES to recalculate all affected scales 
and to work with American College Testing (ACT) in the recomputation of the 
achievement level cutpoints. 

In recomputing the cutpoints, an additional error was discovered in the procedures 
used by ACT in 1992 to “map” the achievement level cutpoints onto the NAEP scale. 
The procedures contained an incorrectly derived formula. ACT used revised procedures 
with the correct formula to map the achievement level cutpoints for the 1994 history and 
geography scales. However, the error in the earlier procedures did affect achievement 
level cutpoints for reading, which were established during the 1992 assessment. The 
1992 national and state reading achievement level results were further impacted by this 
additional error. 

A new version of the NAEP 1994 Reading: A First Look report, containing the 
revised reading results, was issued by NCES in the fall of 1995. The main release of 
NAEP reading results, including the Reading Report Card , Cross-state Data 
Compendium , individual state reports, almanacs, technical report, and data files, 
originally scheduled for the end of September, took place instead in late fall. 
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While some small changes in scale score results were found, the revised numbers 
for reading are quite similar to the results released in 1992 and to those published in the 
NCES April release of the reading First Look report. More specifically, the revised 
reading results are substantively equivalent to the originally published 1992 results and 
to the results released in the First Look. Regarding the 1992 and 1994 national 
assessment data, fourth-grade results are about 1 point lower than originally reported, 
while twelfth-grade results are about 1 point higher. These changes are small and not 
substantively meaningful. The eighth-grade numbers are essentially unchanged. The 
revised numbers indicate the same relative distances between reporting subgroups ( i.e ., 
race/ethnicity subgroups, male, female, etc.). The significant national score decline at 
grade 12 is totally unaffected by the revision, as is the absence of significant changes 
at grades 4 and 8. 

With regard to the state assessment data, all jurisdictions were affected to roughly 
the same degree. Thus, the revised rank ordering of state performance in both 1992 and 
1994 is essentially identical to that originally published. Original and revised trend 
results (i.e., the change in scores between 1992 and 1994) are extremely close for all the 
jurisdictions. However, in four instances (for Massachusetts, New Jersey, Utah, and 
California), the small changes engendered by the revision are sufficient to affect the 
statistical significance of the change. For Massachusetts, New Jersey, and Utah, the 
revised decline in scores is between 0.3 and 0.5 points smaller than the originally 
released results — a magnitude of change that was typical across all participants. When 
rounded to an integer, the original and revised declines for Massachusetts and New 
Jersey are of identical size and the decline for Utah went from 4 points to 3 points. 
Despite this similarity, the revised results for these states are no longer statistically 
significant since the original results were right on the margin of statistical significance. 
In California, the revised decline in scores is 0.4 points larger than the originally released 
results and is now statistically significant. 

In the results for state assessment achievement levels, there is little difference in 
the revised and original numbers from an interpretive standpoint. As expected, 
correction of the ACT error generally results in lower achievement level cutpoints and, 
hence, slightly higher percentages above the various cutpoints. The revised achievement 
level results in this technical report and in the reading reports reflect the change in the 
formula used in setting the achievement levels. 

There is one notable aspect of the revised state assessment achievement level 
results. Prior to the revision, only one state, Arizona, had shown a statistically 
significant increase from 1992 to 1994 in the percentage of students at the Advanced 
level. Based on the revised results, six more states — Connecticut, Florida, Kentucky, 
Maine, Mississippi, and Maryland — also showed a statistically significant increase at 
that level. 




124 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Georgia 



APPENDIX B 



Reading Stimuli 

This appendix contains replications of two of the eight reading passages used as the 
stimuli at grade 4. 
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SYBIL SOUNDS 
THE ALARM 



by Drollene P. Brown 



A red sky at night does not usually 
cause wonder. But on the evening of 
April 26, 1777, the residents of 

Ludingtons’ Mills were concerned. The 
crimson glow was in the east, not from 
the west where the sun was setting. 

The Ludington family sat at supper, 
each one glancing now and again toward 
the eastern window. Sybil, at sixteen the 
oldest of eight children, could read the 
question in her mother’s worried eyes. 
Would Henry Ludington have to go 
away again? As commander of the only 
colonial army regiment between 
Danbury, Connecticut, and Peekskill, 
New York, Sybil’s father did not have 
much time to be with his family. 

Thudding hooves in the yard abruptly 
ended their meal. The colonel pushed 
back his chair and strode to the door. 
Although Sybil followed him with her 



eyes, she dutifully began to help her 
sister Rebecca clear the table. 

The girls were washing dishes when 
their father burst back into the room with 
a courier at his side. 

“Here, Seth,” said the colonel, “sit 
you down and have some supper. 
Rebecca, see to our weary friend.” 

Sybil, glancing over her shoulder, saw 
that the stranger was no older than she. 
A familiar flame of indignation burned 
her cheeks. Being a girl kept her from 
being a soldier! 

Across the room, her parents were 
talking together in low tones. Her 
father’s voice rose. 

“Sybil, leave the dishes and come 
here,” he said. 

Obeying quickly, she overheard her 
father as he again spoke to her mother. 
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“Abigail, she is a skilled rider. It is 
Sybil who has trained Star, and the horse 
will obey her like no other.” 

“That red glow in the sky,” Colonel 
Ludington said, turning now to his 
daughter, “is from Danbury. It’s been 
burned by British raiders. There are 
about two thousand Redcoats, and 
they’re heading for Ridgefield. 
Someone must tell our men that the lull 
in the fighting is over; they will have to 
leave their families and crops again.” 
“I’ll go! Star and I can do it!” Sybil 
exclaimed. She faced her mother. “Star 
is sure of foot, and will carry me safely.” 
“There are dangers other than slip- 



pery paths,” her mother said, softly. 
“Outlaws or deserters or Tories or even 
British soldiers may be met. You must 
be wary in a way that Star cannot.” 

A lump rose in Sybil’s throat. “I can 
do it,” she declared. 

Without another word, Abigail 
Ludington turned to fetch a woolen cape 
to protect her daughter from the wind 
and rain. One of the boys was sent to 
saddle Star, and Sybil was soon ready. 
When she had swung up on her sturdy 
horse, the colonel placed a stick in her 
hand. 

As though reciting an oath, she 
repeated her father’s directions: “Go 

south by the river, then along Horse 
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Pond Road to Mohopac Pond. From 
there, turn right to Red Mills, then go 
north to Stormville.” The colonel stood 
back and saluted. She was off! 

At the first few isolated houses, 
windows or doors flew open as she 
approached. She shouted her message 
and rode on. By the time she reached 
the first hamlet, all was dark. There 
were many small houses there at the 
edge of Shaw’s Road, but everyone was 
in bed. Lights had not flared up at the 
sound of Star’s hoofbeats. Sybil had not 
anticipated this. Biting her lower lip, 
she pulled Star to a halt. After 
considering for a moment, she nudged 
the horse forward, and riding up to one 
cottage after another, beat on each door 
with her stick. 

“Look at the sky!” she shouted. 
“Danbury’s burning! All men muster at 
Ludingtons’!” 

At each village or cluster of houses, 
she repeated the cry. When lights began 
to shine and people were yelling and 
moving about, she would spur her horse 
onward. Before she and Star melted into 
the night, the village bells would be 
pealing out the alarm. 

Paths were slippery with mud and wet 
stones, and the terrain was often hilly 
and wooded. Sybil’s ears strained for 
sounds of other riders who might try to 
steal her horse or stop her mission. 
Twice she pulled Star off the path 
while unknown 



riders passed within a few feet. Both 
times, her fright dried her mouth and 
made her hands tremble. 

By the time they reached Stormville, 
Star had stumbled several times, and 
Sybil’s voice was almost gone. The 
town’s call to arms was sounding as they 
turned homeward. Covered with mud, 
tired beyond belief, Sybil could barely 
stay on Star’s back when they rode into 
their yard. She had ridden more than 
thirty miles that night. 

In a daze, she saw the red sky in the 
east. It was the dawn. Several hundred 
men were milling about. She had roused 
them in time, and Ludington’s regiment 
marched out to join the Connecticut 
militia in routing the British at 
Ridgefield, driving them back to their 
ships on Long Island Sound. 

Afterward, General George 
Washington made a personal visit to 
Ludingtons’ Mills to thank Sybil for her 
courageous deed. Statesman Alexander 
Hamilton wrote her a letter of praise. 

Two centuries later visitors to the area 
of Patterson, New York, can still follow 
Sybil’s route. A statue of Sybil on 
horseback stands at Lake Gleneida in 
Carmel, New York, and people in that 
area know well the heroism of Sybil 
Ludington. In 1978, a commemorative 
postage stamp was issued in her honor, 
bringing national attention to the heroic 
young girl who rode for independence. 



From Cobblestone's September, 1983, issue: 
“Patriotic Tales of the American Revolution.” 
Copyright 1983, Cobblestone Publishing Inc.. 
Peterborough, NH 03548. Reprinted by 
permission of the publisher. 
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HUNGRY SPIDER AND THE TURTLE 

by Harold Courlander and George Herzog 



'Spider was a hungry one, he always wanted to eat. Everybody in Ashanti knew 
about his appetite. He was greedy, too, and always wanted more than his share of things. 
So people steered clear of Spider. 

But one day, a stranger came to Spider’s habitation out in the back country. His 
name was Turtle. Turtle was a long way from his home. He had been walking all day 
in the hot sun, and he was tired and hungry. So Spider had to invite Turtle into his house 
and offer him something to eat. He hated to do it, but if he didn’t extend hospitality to 
a tired traveler it would get back around the countryside and people would soon be 
talking about Spider behind his back. 

So he said to Turtle: 

“There is water at the spring for you to wash your feet in. Follow the trail and 
you'll get there. I'll get the dinner ready.” 

Turtle turned and waddled down to the spring with a gourd bowl as fast as he 
could. He dipped some water from the spring and carefully washed his feet in it. Then 
he waddled back up the trail to the house. But the trail was dusty. By the time Turtle 
got back to the house his feet were covered with dirt again. 

Spider had the food all set out. It was steaming, and the smell of it made Turtle’s 
mouth water. He hadn’t eaten since sunrise. Spider looked disapprovingly at Turtle’s 
feet. 

“Your feet are awfully dirty,” he said. “Don’t you think you ought to wash them 
before you start to eat?” 

Turtle looked at his feet. He was ashamed, they were so dirty. So he turned 
around and waddled as fast as he could down to the spring again. He dipped some water 
out of the spring with the gourd bowl and carefully washed himself. Then he scurried 
as fast as he could back to the house. But it takes a turtle a while to get anywhere. 
When he came into the house Spider was already eating. 

“Excellent meal, isn’t it?” Spider said. He looked at Turtle’s feet with disapproval. 
“Hm, aren’t you going to wash yourself?” 

Turtle looked down at his feet. In his hurry to get back he had stirred up a lot 
of dust, and his feet were covered with it again. 

“I washed them,” he said. “I washed them twice. It’s your dusty trail that does 
it.” 

“Oh,” Spider said, “so you are abusing my house now!” He took a big mouthful 
of food and chewed it up, looking very hurt. 

“No,” Turtle said, sniffing the food. “I was just explaining.” 

“Well, run along and wash up so we can get on with the eating,” Spider said. 

Turtle looked. The food was already half gone and Spider was eating as fast as 
he could. 
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Turtle spun around and hurried down to the spring. He dipped up some water in the 
gourd bowl and splashed it over his feet. Then he scrambled back to the house. This 
time he didn’t go on the trail, though, but on the grass and through the bushes. It took 
him a little longer, but he didn’t get dust all over his feet. When he got to the house 
he found Spider licking his lips. 

“Ah, what a fine meal we had!” Spider said. 

Turtle looked in the dish. Everything was gone. Even the smell was gone. Turtle 
was very hungry. But he said nothing. He smiled. 

“Yes, it was very good,” he said. “You are certainly good to travelers in your 
village. If you are ever in my country you may be assured of a welcome.” 

“It’s nothing,” Spider said. “Nothing at all.” 

Turtle went away. He didn’t tell other people about the affair at Spider’s house. 
He was quiet about his experience there. 

But one day many months later Spider was a long distance from home and he 
found himself in Turtle’s country. He found Turtle at the shore of the lake getting a 
sunbath. 

“Ah, friend Spider, you are far from your village,” Turtle said. “Will you have 
something to eat with me?” 

“Yes, that is the way it is when a person is far from home — generosity merits 
generosity,” Spider said hungrily. 

“Wait here on the shore and I'll go below and prepare the food,” Turtle said. He 
slipped into the water and went down to the bottom of the lake. When he got there he 
set out the food to eat. Then he came to the top of the water and said to Spider, who 
was sitting impatiently on the shore, “All right, everything is ready. Let’s go down and 
eat.” He put his head under water and swam down. 

Spider was famished. He jumped into the water to follow Turtle. But Spider was 
very light. He floated. He splashed and splashed, kicked and kicked, but he stayed right 
there on top of the water. For a long time he tried to get down where Turtle was eating, 
but nothing happened. 

After a while Turtle came up, licking his lips. 

What’s the matter, aren’t you hungry?” he said. “The food is very good. Better 
hurry.” And he went down again. 

Spider made one more desperate try, but he just floated. Then he had an idea. 

He went back to the shore, picked up pebbles and put them in his pockets of his jacket. 
He put so many pebbles in his pockets that he became very heavy. He was so heavy 
he could hardly walk. Then he jumped into the water again, and this time he sank to 
the bottom, where Turtle was eating. The food was half gone. Spider was very hungry. 
He was just reaching for the food when Turtle said politely: 
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“Excuse me, my friend. In my country we never eat with our jackets on. Take 
off your jacket so that we can get down to business.” 

Turtle took a great mouthful of food and started chewing. In a few minutes there 
wouldn’t be anything left. Spider was aching all over with hunger. Turtle took another 
mouthful. So Spider wriggled out of his coat and grabbed at the food. But without the 
pebbles he was so light again that he popped right up to the top of the water. 

People always say that one good meal deserves another. 



Harold Courlander: “Hungry Spider and the Turtle”, 
from The Cow-Tail Switch and Other West African Stories. 
Copyright © 1987 by Henry Holt and Company, Inc. 
Reprinted by permission of the publisher. 
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APPENDIX C 



Setting the Achievement Levels 

Setting achievement levels is a test-centered method for setting standards on the 
NAEP assessment that identifies what students should know and should be able to do. 
The method depends on securing and summarizing a set of judgmental ratings of 
expectations for student educational performance on the items comprising the NAEP 
reading assessment. The NAEP proficiency scale is a numerical index of students’ 
performance in reading ranging from 0 to 500. The three achievement levels — Basic, 
Proficient, and Advanced — are mapped onto the scale for each grade level assessed. 

In developing the threshold values for the levels, a broadly constituted panel of 
judges — including teachers (55 percent), non-teacher educators (15 percent), and the 
general public (non-educators) 1 (30 percent) — rated a grade-specific item pool using 
the Board’s policy definitions for Basic, Proficient, and Advanced. The policy 
definitions were operationalized by the judges in terms of specific reading skills, 
knowledge, and behaviors that were judged to be appropriate expectations for students 
in each grade, and were in accordance with the current reading assessment framework. 
The policy definitions are as follows: 

Basic 

This level denotes partial mastery of the prerequisite knowledge and 
skills that are fundamental for proficient work at each grade. 

Proficient 

This level represents solid academic performance for each grade 
assessed. Students reaching this level have demonstrated competency 
over challenging subject matter including subject-matter knowledge, 
application of such knowledge to real world situations, and analytical 
skills appropriate to the subject matter. 

Advanced 

This higher level signifies superior performance beyond proficient 
grade- level mastery at grades 4, 8, and 12. 

The judges’ operationalized definitions were incorporated into lists of descriptors 
that represented what borderline students should be able to do at each of the policy 
levels. The purpose of having panelists develop their own operational definitions of the 
achievement levels was to ensure that all panelists would have a common understanding 
of borderline performances and a common set of content-based referents to use during 
the item-rating process. 

1 Non-educators represented business, labor, government service, parents, and the general public. 
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For the multiple-choice (MC) and short constructed-response (SCR) items that 
were scored correct/incorrect, the judges (22 at grade 4) each rated half of the items in 
the NAEP pool. These items were rated in terms of the expected probability that a 
student at a borderline achievement level would answer the item correctly, based on the 
judges’ operationalization of the policy definitions and the factors that influence item 
difficulty. To assist the judges in generating consistently-scaled ratings, the rating 
process was repeated twice, with feedback. Information on consistency among different 
judges and on the difficulty of each item 2 was included in the first repetition (round 2), 
while information on consistency within each judge’s set of ratings was included in the 
second repetition (round 3). The third round of ratings permitted the judges to discuss 
their ratings among themselves to resolve problematic ratings. The mean final rating 
of the judges aggregated across MC and SCR items yielded the threshold values for 
these items in the percent correct metric. These cut scores were then mapped onto the 
NAEP scale (which is defined and scored using item response theory, rather than percent 
correct). For extended constructed-response (ECR) items, judges were asked to select 
student papers that exemplified performance at the cutpoint of each achievement level. 
Then for each achievement level, the mean of the scores assigned to the selected papers 
was mapped onto the NAEP scale in a manner similar to that used for the items scored 
correct/incorrect. The final cut score for each achievement level was a weighted average 
of the cut score for the MC and SCR items and the cut score for the ECR items, with 
the weights being proportional to the information supplied by the two classes of items. 
The judges’ ratings, in both metrics, and their associated errors of measurement are 
shown below. 
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TABLE C.1 

Outpoints for Achievement Levels at Grade 4 
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Basic 


38 


2.72 


208 


3.6 


Proficient 


62 


3.14 


238 


1.4 


Advanced 


80 


3.48 


268 


6.1 



* Scale score is derived from a weighted average of the mean percent correct (for MC and SCR items) and the mean paper 
rating for the ECR items after both were mapped onto the NAEP scale. 

** The standard error of the scale score is estimated from the difference in mean scale scores for the two equivalent 
subgroups of judges. 




Item difficulty estimates were based on a preliminary, partial set of responses to the national assessment 
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Revised Achievement Levels Cut Scores and Student Performance Estimates 

The revised achievement levels cut scores and the revised percentage of students 
at or above each level for both 1992 and 1994 are presented in Chapter 3. These new 
estimates were required when it was discovered that there was an error in the program 
used to develop the levels. In deriving the final levels, panelists’ ratings for the 
multiple-choice and constructed-response items were combined to obtain an overall 
rating for the items. This combination was weighted according to the amount of 
information provided by each type of item, that is, some items “count more” toward the 
overall cut scores than others. The weighting was carried out incorrectly, thus resulting 
in the erroneous estimates in the NAEP 1992 Reading Report Card , the NAEP 1992 state 
reading reports, and the NAEP 1994 Reading: A First Look report. 

The process for developing the levels in 1992 remains unchanged and is accurately 
described in this Appendix, except for the step for deriving the final cut scores using a 
weighted average of the mean percent correct (for MC and SCR items) and the mean 
paper rating for the ECR items. The data in Chapter 3 have been corrected to reflect 
the correct weighting procedure, as has Table C.l, which displays the new cut scores. 

Achievement Level Exemplar Items 

The purpose of providing exemplar exercises is to provide readers with a sample 
of the kind of skills and knowledge that students reaching the achievement levels are 
likely to be able to respond to successfully. They are meant also to represent the kind 
of knowledge and skills embodied in the reading framework. 

The selection of exemplar items for the 1994 reading assessment augment the 1992 
exemplars by providing three additional passages (one for each grade level) and 1 3 
additional exercises associated with the passages. The choice was made on the basis 
of criteria similar to those used in 1992, 3 with one additional selection criterion, namely, 
item format. Since the percent of constructed-response items increased by 
approximately 10% over the 1992 assessment, the choice of 1994 exemplars reflects thii 
focus. 

It should be noted that although some exemplars are associated with performance 
data from the 1992 and 1994 assessments (overall and conditional p- values), others have 
only 1992 performance estimates since they were released items in 1992 and not 
readministered in 1994. However, they are all reflective of the assessment framework. 

In Chapter 3, Figure 3.1 provides the final description of the three achievement 
levels for grade 4. Exemplar items, illustrating what students at each level should know 
and be able to do, are included in Chapter 3 as well. The descriptions of the levels apply 
to the framework that underlies the 1992 and 1994 NAEP reading assessments. The 
exemplar items reflective of the levels have been updated to reflect both the 1992 and 
1994 item pools. Table 3.1 in Chapter 3 provides the percentage of students at or above 
each of the three levels and the percentage of students below the Basic level. 



In 1992, both statistical and content criteria were used by the panelists in selecting the best exemplars from the released 
item pool. A description of this process can be found in Appendix C of the 1992 state reports and in the Technical 
Report of the 1992 NAEP Trial State Assessment Program. 
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Reading “Revisit” Study 

American College Testing, the NAEP standard-setting contractor, conducted a 
study to examine the congruence between the reading performance and the descriptions 
of reading performance embodied in the levels, within the context of the reading 
assessment framework. The purpose of the study was not to set new levels, nor was it 
to develop new achievement level descriptions. Rather, the “revisit” was designed to 
evaluate the descriptions of the 1992 achievement levels with respect to their 
appropriateness vis-a-vis student performance on the NAEP. Two methodologies were 
used: (1) evaluation of the achievement level descriptions via statistical item mappings; 
and (2) evaluation of the descriptions via judgmental item mappings. 

In the first procedure the NAEP exercises were classified according to the 
probability of a correct response at selected points on the NAEP scale. One half of the 
panelists then examined the items falling into each category to judge whether the 
exercise content corresponded to the descriptions of those levels. In the second 
procedure, the other half of the panelists were asked to classify each exercise as Basic , 
Proficient , or Advanced according to whether the item matched the description for the 
level. Once all the items were classified by all panelists, they were asked to evaluate 
the extent to which the descriptors represented the skills and knowledge covered by the 
assessment. 

After both an independent and a joint evaluation of the descriptors by panelists in 
both groups to determine whether the 1992 descriptors were appropriate for reporting 
performance on the 1994 NAEP reading assessment, the panelists were asked to 
recommend specific changes in the descriptors. Based on the findings of this study, it 
was the consensus of the participants that the descriptors used in 1992 were, in general, 
appropriate and consistent with the NAEP Reading Framework and the 1994 NAEP 
reading assessment results. However, the panelists recommended minor modifications 
in the descriptors. Their recommendations are reflected in the 1994 Student Performance 
Level descriptors. 
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APPENDIX D 



Data Appendix 

For each of the tables in Part Three that presents reading proficiency results, this 
appendix contains corresponding data for each level of the four reporting subpopulations 
— race/ethnicity, type of location, parents’ education level, and gender — as well as for 
each school type — public, non-public, and combined. 
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J,:. ■ i . M> . -i 


4h :t ' 4 . i 


tl : . |4 i i 


State 




4^32.(..3;4)Vi?,- 


#49:#3;5)tk.- 


•46C3,1)p£f; 


■|lt;3t(.32)r: 


•|ft^21fb3.0)^!:- 




215 (4.4) 


1:214 ( 3.3) £ ; 


t2T3 ( 2.9) 


5 213 (. 2 . 6 ) 


1216(2^)/ 


- 212 ( 4.9)4 ' 


Nation 


P,29.(33);!,. 


^P;38(:2.8)4V 


>■ 52;(!:3.8)k'' 


43 


: j||?4'9.(:2.0);^ .1 


.9)44 




221 (: 2 . 6 )| ” 


■'fan* 


: r 221 ; (:2-1)P ' 


^ 223 ( 2.1)11: 


W216 ; (:2J)1 ' • 





SCHOOL TYPE 


• V v ^>4’ . ; 






* r - •' ~ti. • : 


; ’ "i" r ; 


* lyk’jjfec'*!!- 5 ?! 


Public 


• 41111: ‘ 








W' f v f:f4 




State 


< 'T-'V- • (sss?.s:);'" . 


’'i 32(32)-;- -- 




- 46(3.0)1' 


^-saa=s (j£=:«st)' 


}T-3212M 




'j2==s=: i.i 


.:208(3.4) ; ^;- 




<1^208 (<22)f£ !- 


^'pssssr^sr.-)*:- 


pil 208 ts. 8 )t ; *i 


Nation 


~s (=.=:)!' - ; 


37(25) ! 


" ' ==sa ' 


M 44 (.27>IT I 


=r= ( 2 =.=) 


19(1.9): 




rss^= (sssisr),; 


■ j 21 S (2.1)44 ; 


^.====,(=»^=) : ^ 


..^ t 2171-1-8)fi ; 


|4f^'(==^=) ; 




Non-Public 


• is-;, • ^4 • . 


^ - 'ft 




'1 - ■- f' 


if ; 1 : : 


- 4 :<r 


State 


ssssss. (sss^s). 


•' % 59 (19.5)!? 




a 25(17.0) 


;'^S»=Sa,(5B=VB) . 


, 16(16.4); ; 




’" s==j (sjs.^)f- ' 




:'f ? iSS 55 ? (is.=) •’ 




1 |— s^ss ^- 1 




Nation 


(c=.~) 


: 58 ( 6.3) ; 


.. :==a (ass.=:) 


32(6.0) 


•v-aassE (jas^s). 


10( Z9) ; 






r|23i:-('3^)ti* 


£;.=== (asr^r); ; 


£v229 (4.8)fh i 


^sE=sr’:(=n=i=s)f, 


. r 1232 (25)1;: ;; 


Combined 






? ’ ‘ ■' . 




•• ;; 




State 


ssssst (srs^a)^: - • 


i;34(3^)!: 


ii«SS=:( 8 Ba«Ss):r 


44 ( 3.0)1 ? ; 


• S5SSS; 4 **) :< . 


a^ 22 :^ 2^|-1 




Lssssst (sss.s:) • 


1211 ( 3.1)- 1 


, ssbbp (=.=:): ; 


*~CV) 


•'■'■•sssss' i (ss».s : ): ; 


* *~rn^ ■■ 


Nation 


— sa (=ss.s) 


- P 39(2.3)- 


sssss (~^~) : 


43(2.5)--.: 


:.:; 2 =s==-(ss=:.=:)' : 


. ^ 18;(1^. 






'•'I217 ( 2 . 0 ) 


:assss-(si=:.-ss)' - . 


218 (1-7)? 




; 4-202 'j( 3.7)T? 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D5.3 

Public School Teachers ’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 



I get all the resources I 
need 



1992 



1994 



I get most of the resources 
I need 



1992 



1994 



I get some or none of the 
resources I need 



1992 



1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



Percentage and Proficiency 



10 ( 1.5) 
5 : 215 ( 4 , 3 ) 

111 ( 1 - 7 ) 

220 ( 3v1) 



■•'228 ( : 

'«m ( 2 . 0 ) 

( i: 8 ) 

* 1 10 ( 119 ): 

| 3 / 6 p£)£: 



19 (2.5) > 
216 {; 4,6) : 

■ 

225(3.7); 



S^: 23 i;( ; 4 , 3 F : v^ 

K L io ( 2 . 0 ) : 

19 ( 3.6) 

194 ( 6.6)1 
7(1.9)- 

; i:e ( 2 - 0 ) ; 5 v 






lit®)® 

^•- 8 ;o 2 .i>/- 

;214 (10^3)1 

fcl 2 (, 2 jB)L 
i 224 ® 5 :l^S 

lllSfifttii 

218(419)1 

ilwilii s 

1225 (.3:0)1 ' • 



18(6.1) . 

~r.*> ^ 

/iff 10(2,9 ||g$ 

/ y ^: 

20 ( 4.6) 

; ! 221 ( 6.9)1 
id ( 2 xi) / 
229 ( 6.1)1 

17(2.5) 

. 216 ( 62) , 
223 ( 5.0)1 



56 (3.0) 
213(1.8)1 
V. 51 ( 2.9)1 
218(1.7):; 



58 ( 2.8) 
207 { 3.1) 
'«55( 217)' 
215 ( 1. 6) 



( 3-2) :«a 

! iS223!(|f i .6)Si!: ! ■ ; 222 ( 1 .9) 

5 : 53 ( 3.4)i: .'U: , --558 (32) J 
224 ( 1.9) SI 223 { 1 .8) ., - 1 
s i s ’ 

52 ("4.4) “5 til , 55(42) i! 

Ii96#3^|lil*l85 
: '.140(4.0) IE' :46 ( 5.0) 11 

:1S2( 2.6) •••¥.: 186 (22) , || 

¥ 45(517)/' .1; . 57 ( 5.4) % 

(".•) 183 ( 8.9) 

: 50(42)..: :%;: .. :,-s6{3.6f!-}h 

203 ( 3.0) 192 ( 2.6) < 



44 ( 8.2) 45 ( 4.7) 

200 { 6:5)1 i 1 199 ( 4.6) % 

47(4.0) 46(3.9) \ 

210 ( 3.0) I : : 207 ( 3.7) 

59(4.1) 64(4.8) 



f: ; 59 i(^ 11 ): 

(219 ( 2:8) 



64 '( 4.8) • J«| 
213(6.4) 



• '45 ( 7.3) Sf4*:!S65;( 4.9) . 

1 219 ( 4.3)1; V 212(25) ^ 

U imm ' fm 



33(3.0) 

210 ( 2 ; 6 ) r> 

39 ( 3:5)fi? 
213(1.6)/ 



24 ( 2.7) < 
204 ( 3,1) , 
35 ( 2.7) ftp 
208(1.8) l 



;r 30 ( 3 . 5 ):t 2 ^i-. 22 ( 3 ^) ? 
222 ( 216) Jv ^ 220(3,2) * 
36 ( 4^)/: •: ;;ai; 32 ( 3.2) 
221 : : ( 1 ; 8 ) ;220 ( 2 . 0 ) 



/ 37 : ( 3.7) 
SIMS ( 2,5) 
- 49 ( 4.0) 
;,;1.96,{ : .2^) 

/ '5 „ v <' , > 

'49(6.0)1 
!;! i188 ( 7.9}“. 

;j»f|i;('42)| 

*;198( 2.7)1 



26(3.6) 

8rj®tl83 ( 2.7) <1 

&?S8fl47 (4.7) IS: 
a%Si ^^T 2 . 3 );<$. 

SSi 524 ( 4 . 5 )i| : 

41 (4.1) 

186 ( 3.3) 



45 ( 6.9) 37 ( 7.5) 

a 204 ( 5.0) %: %; 197(8.7)15% 
I 46 ( 3,7) *> . “44(3.6) ¥ 

j®29 (Aif&St&iMf, ( 3.8)91/ 
J'2t7:( 3i3)J2» 210 ( 7:0)1® 
'lis3e'(4.Q|lfeet%33.^4i5)as 

218 ( 3JB).1%:,.216 (2S) i; , 

. 27 ( 4.4)!® 
207(3.5) 204(32) 

, . 41(9.7) - ,28(4.2)-:;fe 



(continued on next page) 



14 ? 

140 THE 1994 NAEP TRIAL STATE ASSESSMENT 



Georgia 



THE NATION'S 
REPORT 



CARD 



ivaep 



a 



TABLE D5.3 (continued) 

Public School Teachers’ Reports on the Availability 
of Resources 



1994 Trial State Assessment 


1 get all the resources 1 
need 


1 get most of the resources 
1 need 


1 get some or none of the 
resources 1 need 


1992 


1994 


1992 


1994 


1992 


1994 










Percentage and Proficiency 






PARENTS’ 


if ' <, ' 


JlilliSSSSiS 




' 's G " ? , /’ %3 , } ; T 


' ; ; ^ 


?( s. - ; : 


EDUCATION 














College graduate 


IN: ' 1 V 


11 1 iBlil 


'' ' f' '7- 






rfx'fv .- ; i' • > 


State 


mm ( 2:2)31# 


20 ( 3.1) ; M 


ISilll'is)/'* 


* 


31 (2.8) 


It > 24 ( 3.4) i'll 




223 ( 6.0)! 




! 222:(2;6):,i;ii!| ; ! 


•l!::220(3.1): 


218(3.7) 


Wim&{4ja) =•'::• 


Nation 






:II|51|(#^MI 


54 ( 3.1) 


37 ( 4.0) 


<f 36 ( 3^) 




>! : 226 ( 4.8) , 




225(2.4) 


Jfi225(:i.8) 


222 ( 2.3) If! 


217 ( 2 .4) 


Some ed after HS 














State 


10(2.6) 




50(5.1) : 


52 ( 42) 


40(4.7) 


II IS S ( 3.9) < t 




*** (***) 


*~r*> : j 


Wl^ms0M 




• ilgpiQilil 


— rn 


Nation 


10(2.5) 




1 54<4.2)'f'i 


53 ( 4.5) 


1 36;ij5^) 


>1:36^4.0) -'1 




0^ , v>'. 




:lg§p|;2#j f 


|i^:(i3^j||| 


••^223^5.3)': 


||21^('3.9) A 


HS graduate 






A ' 1 




^ o r : ■ 'Sf'i v 




State 


8(1.7) 


15 ( 3.1) 


A : :53f 4X0 : < 


60(4.2) 


39(3.9) 


lllllilillll 




***(**■*) 




& 206.^3^111 


;' .200 ( 4,6) ;V ; 


205(3,1) 




Nation 


u<2.6) m 






f-,155 ( 3.6) [f;i 




pill 36i(. 3.0*1? 










||2i0(gg||| 


208 ( 2J2) 


'203<^5)ji : rg 


HS non-graduate 


' ^ 


C<4~, 








- r # ' "'{ ' * 4 'i 


State 








Sb2(5.7)>4 


36(5.3) 


Hli29 : ( 5/4) i| 






"*(*■•*) 


■ r ^06<4.0):fr;f 


183(8.4) 






Nation 






i 39 ( 4.6)-/^ 


60(4.1) > 










2:*-:***:^* *| • ' . . 


$96 ( 5.3), 




||198I('4 f 9) 'f 


|!|82.{6^);ig 


1 don’t know 


y ' i{ - '/ \ l 'i " : 




iltepV 




ill : : ji/f > v 


i / s 


State 


10(1.6) 


mmmm 


l'i5il(3.2). 


^£;So^3:i)fj|l 




Pfe : 23 (S.6) ' - : 




209 (3.8) 








f 1203 < 23) : -il 




Nation 




IlliS mms 


*|S^2.9)At 




38 ( 3J2) 


34(2.6) 




iiWIlffPSiSi 




f '212 (2.1);| :: f 


®^(i2:3)|g! 


206(1.8) 


202 ( 2.0) ; 


GENDER 


r< f A; 


: y%? 




Srtiilii >Ali' 


^ „ > { 


f/' i 


Male 




SI f ~ 


, '■ - % 


L : l | 'i ’ , \ v If 


v ?:»^v '1 




State 




19 ( 2.3) > 


^'^56 




5®35 : ('3.3)- '' 


25(2.8) 




215 ( 5.1) & '\ 




' 2£)A ' 


^201 ;; (-3:9)H| 


206 ( 3«3) p 


l#^i(-4.o) M 


Nation 


mmwmm 


9(1.6) 


' :51-C3.0)^ft 


ip53%('2dB)'r® 


* 38 ( 3.7)i - : 








} 222(;34); : A: 


214(2.0) 




llll 


#202 ( 2.1),<jr 


Female 


~~ , A v i 


b’, **»**-' ^ 


N (lU!:: &|jr! 




ii'-li-vil;: iff: 




State 




fl®e^23) .if; 


sell!®# 


k£9*{*A)v$* 


32 ( 2.9) 


! T : 23 ( 2.8) 




112*5^5.2);^ 


221 < 4.4) ''J || 


S 215 ( 2.0)::.. . i 


1 :212(2:8) ; 




li^to < 3.3)'v;; 


Nation 




4 4*0 { 1.9) '4* 




i^54{^.8}ill; 








224 ( 3:5) 




222(1.8) 


221 <1.8) 


l i2TT( 


li|i^i( J 2!0gP8 



SCHOOL TYPE 






Public 


r - v , !. rB\ 


y :-. tif 1 


State 






Nation 






Non-Public 




=—(-=) 215(1.6) 


State 




,W(^=) 54(14.1) 


Nation 




'49-('4.9) ; |l ' 


Combined 


230 ( e^)! Iff 




State 




-(-==) 58(2.8) 


Nation 


\ Mtm&m 


<=.=) \ ■ ' 209 ( 3.0) m 

mzgky&zM v 






= (=&=£) 216 (IS) 



7{^ 






liittIll2G8.{T 8> M 




&&is 






... ., . .. ... 

; 36X2r4}' v 

§)l!Ml30ISlSr 



= School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. ! Interpret 
with caution — the nature of the sample does not allow accurate determination of the variability of this statistic. 
*** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.1 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Tnat State Assessment 



Primarily Basal 



1992 



1994 



Primarily Trade 
Books 



1992 



1994 



Both Basal and 
Trade Books 



1992 



1994 



Other 



1992 



1994 



TOTAL 



State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 



LOCATION 



Central City 
State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



29 (.33) 28 ( 3.4) 

210( 2.5) ; 203 (2,5) 
33(2,6R; 18(2.4) 
213 ( 22) 208 ( 2.4) 



27 '26 ( 4.1);: 
222(2.4) 217(2,5) 
31 ( 3,1) 16 (2.5) 

220 

4i • fill 3 i I(lsl2)i# 

196(3.1) 186(30) 

42 ( 30) ; : :h31. (4:8) ! 
•197^P 5 :;lte ; ( 217)4. 



24 

200(4.4) 

28 ( 7.9) 
200 { 417)1 
;.39:|4;9) 

'23^1^1 

;2l|j|||8 

:43|(62) 
213i<|3^i 
39 ( 62) 1 



:26( 4:5) 

I|93;:(;52g 



: 1 8 ( 4.8) 
@90 (104)1 

;-T:-;.21;(r4,3).J- 

:Ji|8;(.4;i)t, 

2(^(6.0)!; 

mmmrn 

¥%2${62) % 
204 (3.1) ? 
@ar(5; : iH; 
,2Q9:(5;3)l 



Percentage and Proficiency 



* - ' 


~ 





mw) 7(1.8) 


: 59 { 3.5) 61(3.6)1 


5(1.3) 4 (Hi?) f 


2t7i(mS)l 216(5.6)1 


213 (:2^) 209 ( 3,6)1 


,207(8.4)1 206 ( 8.2)! 


' 20(2.8)1 


asi43^) : 59 (3:0) 


3 ( 1.1) 3 (0.7) 


^:;(:i^):.:,,.218 ( ;2;9)i: 


217 ( 1.4) 214 (1.7) 


208 ( 6.3)! -197(-6.1)t 


: : f8‘( ; T;8)!:-: ; . 8(2.3) : 


1 jT' i-i - ;*: 

61 (4.1) 61 (4.4) 


•; ; :4 ( 1.4) ;•;» 


231i( 42)1 228 ( 3.8)! 


2231(22) 225(2,4); 1 


:*** (•*.*) - 224(58:5)1; 


=rii(ifi7)r': ; 22 (3.4R 


52(4.1); 59 ( 3.8)1 


3(1.1) 2(07)5;; 


229 ( 4.0) 222 ( 3.3) 


;224;(1r7)' 224(1.6) 


215 ( 65)! 212(8.2)! 


6 ( 32) 5 (1.8) 


53 ( 4/7) •< ; 60 (4.9) 2 


||6;<;i : .^Ml;Si|S)| 


'<*** ^4* |. >*+■* ,5*^ ,, 


195 ( 3:3)11387 ( 4.8) 


*** .<>*•** |** 




^46(42)1^.57 (4.7) 


3 ( 1.6) ' 'ip3-("1.2) 

*** r-*> *** r*> fi 

V 5 (2.6) 6 ( -2 0) : 

*** 

*" {”•? r.*? 

6 ( 2.6) 4 ( 2.9) 


,^.(f*:*) r .199 ( 4.8)1 1 

6('2.d)"| 

204 ( 7.f|p95. ( 4:9)( ; ' 

6 ( 4.9) ■ 8 ( 5.9) ! 

crtim 


;1^(:24)?; V ;186.( : 2.4)|| 

.63(6,3) 62(5.0): 

189 ,( 6l9) 185 ( 9.2) 

' 49 (3.9) i; -61 (3.5) 

204 ( 3.0) 190 ( 3.3) 

59 { 8.7) : ‘ 70 { 6.9) 

205 ( 6.3) i ; 202 ( 6.9) 


19 (4.8)5 


43(5.1) ' .57. (5.3)1 


; 3(0.9) 1 V 3(oi9)! 


-215t(f6^^|215;( ; 4^)f| 


209 ( 3.5) 204 ( 3.5) 


***<“:*) 195(14.0)! 

2(1.4) 4(1.8) 

m r *) ; pps| 

^|2.9) 3(1.8) 


227 ( 5.9)1 221 (6.1)1 

-Si5;< 3 > 6)r;!l22:(4E6)f 
22S'(;8'.8)!/.;224 V 

*** |*« *| 
i7 ( 6.6) 
227 ( 5.6)! 209 ( 8.8)! 


68 ( 4.4) 70 ( 4.6) 

219 ( 3.1) iS£f 5 (6.6) ! 

^^|)||2J0:(|i5||} 

49 (5.7):! 47(5:1); 
208 ( 2.9) 206 (3.0) i 

45 ( 8.6)1 59 (5.4) 

218 ( 35)15 - 217 (2.4) 



(continued on next page) 
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TABLE D6.1 (continued) 

Public School Teachers’ Reports on Instructional 
Materials for Reading 



1994 Trial State Assessment 


Primarily Basal 


Primarily Trade 
Books 


Both Basal and 
Trade Books 


Other 




1992 


1994 


1992 


1994 


1992 


1994 


1992 


1994 


PARENTS’ 






Percentage ar 


id Proficiency 




• 


EDUCATION 






ililllig if§ 


: "?v!; { :: * ' 










College graduate 




S23|3fi|l 




} . f?' ' y 




66 ( 3.6) 


6(1.7) 


4 ( 1-3) 


State 


27 ( 3,4) 


7(1.7) 


7(2.1) 


60(4.0) 




219(2.8): 


209 { 3.5) 


:222::(!6;4)li 


::229lpi3)i| 


223 (3,4) : 


1221? (3.3) 


- r .*) 


: TV) ‘ : 


Nation 


32 { 3J2) :. 


■17 ( 214)1 


lilSifaS):::.; 


22(2.9) 


50 ( 3.7),; - 


59 ( 3.5) 


3 ( 0.9) 


3 ( OiS):I 




220(3.2); 


212 ( 3:0) 


233 ( 5.7)1: 


229 (2.5) ; 


225 (1.8) 


224 ( 2.0) 


(— ) : 


211 (9.1)1 


Some ed after HS 








' f : 






.1 


4 ( 2.5) ; 


State 


29 ( 4.6) 


.:;3ilIi)iS 


8(2.8) 


6 ( 2.0) 


56 ( 4.4) 


63 ( 5.0) 




; *rt;^** : 


209 ( 7.8) 1 




: ^ r*) 




224 (3.9) ! 


femKTtWl 




Nation 


^•29 !(-38) : 


17 ( 3.3) 1 


m&0£) • 


21 ( 3.7) 


53 .( KSfau! 


59 ( 4.8) 




3(1.4) 




222 ( 4.9) '^1 


221 (4.4) 




218(5.4) 


221 (:a|g; 




IBfiill 


•TV) 


HS graduate 










i - ' 


2(0.9) 




State 




,:36 ( 4;9) 


9 ( 29) 


6(1.8) 




; ?54 ( 4.8) : i!!i 




207 ( 3.7) 


204 (Z2) ' 


f ) ■'■ • i v i 


n^ie^gai 




196 (6.0) 


***(**.*) 


-+** 


Nation 


mmmm 


20(3.2) 




•-14(3.3) = 




: 63 ( 3.6) i 


3(1.4) 


3(11) 




213 ( 3.8) 






2#j : 4.7)i jij 


213 (2.9) | 


208 ( 2.6) 


r*r-*> ! 


TV) J 


HS non-graduate 






r;' — : '' 


:'#.(. si) 5 


IHsiei)!} 


4(1.8) 


; 5 ( 2.7) : 


State 


WM #6) 




Wmtz. 7)7 


^•/S.('2^) Hi 




mr^< 


192 (!43)f 


(-7) 




It.97^a2)!i 


180 (11 J5) 






Nation 




11221# #11 


10(3.0) 


WK ( A At-. 


i^isaai 




iillllll 


3 




IlSIli 




; t. 


200 ( 5J2i)| v 


||90j(:||li 






1 don't know 










62(3:8): 




l®5iii)M 


State 


31 (3.7) ’ 




7(1.8) 




ila (3.9). 


Mils 




201 (3.2) : 


:197 ; #6)!* 


**'(**•*> ■ 




206(2.3): 


201 (4.0) 




I r*) n 


Nation 


34 ( 2.8) 




143 (22) 


19(3.1) 


S0(:3J) 


?;I58(3.0)< 


IKM^l 






207 ( 2.4) ; 


;|ca|(lg8)|J 


215 ( 5.2) 


210(3.6) 




: 206(1^)g 




181 :( 6.3)1 


GENDER 


fM 






■i.. : : : • • 










Male 








s - 










State 


29 ( 3 4) 




iiili#; 


f^fiwWk 


;58(36) :! 




ysc i:4)l 


f;#4;p^)'; 




£&$$ ip! 


'496: ('3.2)':::' 


&S7 ( 7.9)1 


206 ( 7.4)11 


210 ( 2.6) : 








Nation 


Sfe(-2*);£l 




144. ( 2.6) 


; ;ia);((2.7)'.i. 


51 ( 3.9):$ 




Wit- 1)3 


3 ( 0.8) 






202 ( 2.3) 


i|§|$&S)g 


|213l(|37gf 


lllllllS 


2C^J||||8g. 




187 ( 8.3)1 


Female 




^ .. : 






] p PPlil 1 


^4(1*3).' 


- 


State 


30 ( 3 4) 


%2$(&srf: l 


7(1.8) ; 


7;< i.8)-‘ 
224 ( 5.8)! 


|59:-<3ig 


: : '60'(i#l 


4; 4{i3) 




<zm c a-9) 




216 ( 8.7)1 


215 ( 2.7)1: 


l2l4|(>3-2)^ : 




”• r*) 


Nation 


::-34'(:i2.7);. 




13(2.1) 


SlSIi(s3.0): : ■ 


^60(^3)'! 


116&(;3^)S 


1^.1) 


? : :3ji&7)4 




217(2.3) 


214 (2.9) ; 


228 ( 3.9) 1: 






l220t^^ 




208 ( 6.3)1 



SCHOOL TYPE 



Public 

State 

Nation 

Non-Public 

State 

Nation 

Combined 

State 

Nation 



S k 

glfe* 

jag 

ms 

g|® 



j® 

f ^ 

gft: 

1® 



28(3.4) 
203 ( 2.5) 

i iiipap 

5^42 (2Q-2) 

230 ( 3:2); 



^||29.(a4)§ 

r$8T 

(2^) 






= <=g # 8 ( 2.0) 

— <= -} 19 ( 2.5) 

^^ig|§r|| 2.8) | 



Bn 

Pi® 

§pi 

gs®- 

IS 

§gte 

g§§§ 

i» 

i»§ 

s® 

itii 



;:> ii:;:; v v ■■: •;>>: s&^ss: ; 

lpS6t:( 3.e|p 

209 ( as) 

|l ' 35 (17.7) 
is) !:; 229 (2:5)1 



:5) : ; ;s7^;a6) f 

=.=) 215(1.6) 



== (=v=) 4 ( 1J2) 

~{==.==)\:206 : (:8.2)l* 
= <==-=) 3(0.7) 

= (=.=) 197(6.1)1 

“<=•=> .0(0.0) 



= (==.=) .. 222 (16.4)1. 
= (==■=) 4(1.1) 

= (==.=) 202 ( 5.0)1 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

= School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2A 

Public School Teachers’ Reports on the Frequency of 
Using Children’s Newspapers and/or Magazines 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1992 


1994 


1992 


1994 


1992 


1994 


TOTAL 






Percentage and Proficiency 






State 


ISiHI 


ISIoJiilllg 


kiftl .( 2.8)J||| 


39 ( 32) 


:^ 28(2.4) J:-lj 






: 215 ( 2.6)? ' 




.p2io.(;2:3)iiii 




: C212(2^>| ; | 


206 ( 2.8) III 


Nation 


32 { 3.2) 


® 30 ( 3:0) 


ill C32.( 2.4) „ 


|| 36 {.22) : f|l 


II:: 36 ; < : 2l6) r : : i|ii! 


ii|:35:(:2.8)ili 




218(22) 




213(2.0) 




;B218(2.1) C £j 


214 ( Z2) 


RACE/ ETHNICrTY 






White 












' ■ ■ " : . ' >...■ ■ 


State 


31 < 3.1) 


27(3.7) 


39(3.1) 


iiisiSiiiiii 


8IS* ( 3.0) 


32 ( 3.4) 




y 225 ( 2*5) - • 


#2aifaL4):r^ 


221 (2.2) 


il225f(:2:5)il| 


•: ii223 C2.1pp;|| 


218(2.5) 


Nation 


= •:; 33 <319) ' 




29 ( 2.7) 


pi 35(2.7) 


38(2.9) 


35(3^) 


Black 


225 ( 2.3) 


223(2.7) 


221 ( 2J2) 


223(1.8) 


j jg||;2J2)'. 


1,222(2.1) |i 


State 


30 ( 42) 


•y'-:32.( 4^7) SI 


II 44®.4)llfe 


34(3.6) 


: ' 26 ( 3.2) 


34(5.7)S:y 




198(42) 


y; 


IS i94 £3Jijyl; 


185(3.0) 


1:192 C 2.7) 


mm, ( 5;4^lfl 


Nation 


30(3.5) 


* : 31^ 4i>) 


piS(! ; 42)^li? 


35(4.6) 


|||28l(4.1)( > 


34 ( 4.6) 


Hispanic 


194(3.3) 


SlllS : M II 


195 ( 2J5) 


^185 (3jg,; 


fg:f92j( 3J9)^ 


190(2.6) 


' ty 






State 


38(5.6) 


S! 33 ( 5.6)0 ;i. 


/'! 


38(4.8) 


29(4#lf 


29(4.6} 


Nation 




■; i89(9:8)i; ! 






«n»# : (**-'*J ji 7. '\ 


**♦ £4* • 










36 ( 3.4) 


33 ( 3.9) 


TYPE OF 




190(4.5) 


197(43); 8 


188(2.8) 


205 ( 3.5) 


193 ( 3.7) 






! • v< : ' l v 




LOCATION 












, yy 


Central City 








i gi 




SM'J >' • ; t' ’’ -|j 5 'jlv ' 1/ 


State 


t '30 { 5,7) 


: 42 ( 7.3):' JJ 




38(5.3) 




20 ( 8.6) 




204 ( 6.0)1 ; 


200 ( 6.9) 


II 200 ( 5:1) .;M 


201 ( 62} 


^ r A) 




Nation 


30(2.9) 


22(3.5) 




: 40 {32} 


: 1.129 { 3.7) p 


38 ( 42) 






201 ( 5:4) H 1' 


2/4) >>' j 


1^03ii2.n 


206(5.2) 


207 ( 3.6) 


Urb Fmg/Lrg Town 


* t-2\ 






State 


/■' 35 


1:^32 < : 4® : 


iSHiliiliill 


39 ( 4.2) 


32 ( 3.4) 


: 29 ( 4.4) : 




. ^222(2:9)' 111! 


->213'( &5)i ' 7 


216(4.0) 


213(4.8) 


218(3.0) 


215 ( 4.4) 


Nation 


^25 (4;o) J 


37 ( 4.3) 


29(2.7) 


34(3.8) 


> 46(4.1) ; 1 


29(3.7) 


Rural/Small Town 




217jC^4)^; 


219(2.6) 


220 ( 2.4) 


; 223 < 3.3)|j ■ • 


9^24^3.1).; : r : 








#| " r | 


; j, 5 . 'iC '/fi/ :< 


State 


28 f $.3)'" J 


Ijll0:(^lill! 


42 ( 4.5) 




i 


.41 (5^) 






205:(:4;8)! fi 


212 ( 3.3) 1C? 


211 ( 6,2)1 . 


I§209.{ : 3.7)- §3 


: 201 ( 32) M 


Nation 


H43(&8)? : '*! 


iy-;27^6.4) - v 






30(4.8) 


39 ( 6,0) ; 




3.3)1 J 


: ::219 (6:5)1 v 






217(2.3) 


:y2$Q'(l32&' 



(continued on next page) 
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TABLE D6.2A (continued) 

Public School Teachers' Reports on the Frequency of 
Using Children ’s Newspapers and/or Magazines 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 








Percentage and Proficiency 






PARENTS' 














EDUCATION 












: -7 


College graduate 














State 


33(3.0) 


29(3.3) 


39 ( 3.1) 


' 39 (; 356)7 l 


28 ( 2.9) 


32(3.6) ; 




222 ( 3.7) ; 


221 (5.4) 


220 ( 32) 


221 (4:0): : 


222 ( 32) 


214(3.5) S; 


Nation 


33(3:8) ; : 


p "30 ( 2.9) 


30 ( 2.7) 


:• ;35.(;2.4),i7 : 


38 ( 3.3) 


35 (;32) : ;irf 




224 C2.6)'C^ 


223 ( 2.9) 


219(2.6) 


■'M 


228(32) 


223(2.7)77;;: 


Some ed after HS 






.. : : r i Vj ( 




, : v. 7 7-. 


,; : • • ',a f r 


State 


:: ' 


11-29 


44 ( 4.4)77!/? 


38(5.7) 


;::::::27(^;4)17' ; : 


32 ( 4.6)' 1 7 




- 


ft: 226 :C5.7) - • 


212(5.7) 


: :.:225^4:8)lp;7 


: *«• : - ly 


215 (6.3) >7; 


Nation 


34 ( 5,0) : : 


• 7 35(4.0) 5 


29 (;3.5) 


34 ( 3.1); JR 


37 ( 4J5) 


32;(:3^mf 




228 ( 5.5) 


y:2l8. (3.5)7 


215(3.9) 


r 2l8;f^;^7 


222 ( 3.7) ; 


229 ( 3.6) 


HS graduate 












- ' • 


State 


29(3.5) 




41 ( 3.6) 


38 ( 4;i)7 i 


29(3.1) 


;&X4&piX: 




205 ( 3.8) 


202(5.8) 


205(32) 


197(5.8) : 


204(32) 


202 ( 4.9)7.77 


Nation 


35 ( 4.7) 


7H;30(4.7) 


31 ( 32) 


34( 3.3) O 


35 ( 4.0) 


36< 3.5) ; ,r 




214(4.1) 


208(4.0) 


212(4.4) 


204 ( 3.5) 


211 ( 32) 


210(3.4) 


HS non-graduate 




" 5 ‘ : ; 




• 777 7/ 7 




* , . • •: • ' • 

•a • .J// 7”> ' 


State 


33(6.7): 


< 5.6) 


39 ( 6.4) 


35 ( 5.5) > 


28 ( 5.3) 


.38 ( -6^);. 777 




■*#* ; - 




~r.*) 




«♦ t| - 




Nation 


37 ( 4.8) If 


127(4.7) 


33(5.5) 


-30(3.4)77 


30(52) 


44 (. 5-0)711 




199 (5:6);- ^ 4 : 


182 ( 5.8) , 


198 ( 4.9)1 


■ • 192(6.3) 


7 .;*?¥$ • ;• 


• 190 ( : 7.7pif 


1 don’t know 


/ .• ' f \ 




■ 'i 




• 1 IsJ .'{ -i.>i r" ;f* 




State 


28(3.2) 


Sfc!^9f3:5): ; : : B8 


h 43 ( 3.3) M 




729.(2.7)7: 7: 






208 ( 3:3) : ; 


; fli;97l(-5i3)7- 


4 7203 ( 2.2) ^ 


77202 i&wm x 


■4:204 (22) 4 


199 ( 3.7) 


Nation 


29: < 310) 


771281(3.2)7 


7: 35 ( 2.8) 


■ :; 40(2.5) 7 7 


36(2.7) 


: 32(2:8) 




212( 2.6) : ; 


7206(2.8) ; : 


209(2.6) 


: 205(:|4 : ) ;: ;7; : 


210(22) 


205.(2.6) 


GENDER 




»IPW^:7 '/> '\- 




:: 7 : ^|37fc77- 






Male 




Vtylijm.f.-?;:'' -r: ! 










State 


31 (3i1}7 * 


71|29t3.3) ; - 


40(3.4) 


7 - 436T2.7)- f- 1 


29(2.8) 


34(3.3);«Ii 




214 ( 3,2} 


77202(3,6). 


207 ( 2.5) 


202(3.4) 


209 ( 3,1} 


202 ( 3.4)»:-; 


Nation 


31 ( 3.5) ; 


7$:530<2.8) 


31 (2.5) 


36(2.3)7: 


37(2.9) 






215 ( 3.0); 


208 ( 2.8) 


210 ( 23) 


;• 4206>$&f)! i; : 


213 ( 2.6) 


:209'(2^|J; 


Female 








■ ■; 






State 


30 (2:8)7 


mm 


42(2.7) 


40(3:9)7 


28 ( 2.4) 


■ ' ?3t (:3:4J;^i- 




216(3.1) 


3.7) :• 


21 3 ( 2.8) 


; ,216 ( 3.7} 7, 


215( 2.7) - 


-210-(;3:1);?7;7 


Nation 


32 <3:0)7 


29(3.2) 


33(2.6) 


•36(:2;3):ir;i 


35(2.6) - 


7 : ^as^ogil 




221 ( 22) j$: 




216(i2.1) 


246(1 7) 


223(22) 





SCHOOL TYPE 


<1: 












Public 




*■ • f; S' X' - '' • = 




• ■ 'F\ '< i 




* . ; ( 7':. 


State 


■ ; 


7pI|S29'-C3.1) ' 


■ ; •= (sss.st); 


'l777'39(3'i)77: 


'■ ^=K5-(=S=:^)' 


1 I33(:33pi 




-as (~=r.~) : 


-1;f2G8{4.8) ' 


: sss (==.—) 


•7r : ;^to C3^ ^ • 


== £==.=) 


206(23^:1' 


Nation 


' (==:.-) 


•; ff3Q.(.3.0) 


-=r.rr-. (ssrr^r) 


- ! : 36 ( 23 - 


===== (=.=:) 


135 ('23^7 f 




== (sKr 4 =r) 


4: : 213 ( 2.3) 


«=SSS (=:=.=) 


212 1 13 


== (=;=) 


.21.4 


Non-Public 












. = ■ ' "f 


State 


5 


: 7&6(52) 




34 (17.4) 


== (d=.=) 


60(16.2) '‘5 




—7^'^ (SSSP) 


:.vrn 


sr= (=.=:) 




=S= (=?.=) 


231 (8.0)1 :7 


Nation 


(—.=:) 


30(4.7) 


T7 (S-SJS) 


28 ( 4.1) 


.== (=.=:) 


42 ( 4.5) 7 




==;. (=,=) 


229 ( 3.0) 


== (==.—) 


230 ( 5.3) 


= (=.-) 


232:(4 ? 1;M7l. 


Combined 




■ 7|l5.. : 




• 






State 


(sns^a) • 


: .Mmxm 


===== (=^i) - 


38(3i> 


== (=:.=) 


: 34-(3#t J 




(=.=r) 


i 


===== (=^=) 




'=== (=.=:) ‘ 


■ ^(2:7>;Ci 


Nation 


: — (=.-) : 


7^t;i7430 : (.'2,7)~- 


. == (s-c) 


■ ■ 7135 (2.0) :i 


===== (=.ss) 


•35'(23)ri 




? — — (rrrr.ss) ‘ 


7' :4p215C22) ' • 


===== 


• ; 7 7 214(13 :: ; . 


===== (----) 


216 ( 2.1)tJ t: 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

== School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2B 

Public School Teachers’ Reports on the Frequency of 
Using Reading Kits 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



TOTAL 



State 

Nation 

RACE/ ETHNICITY 



White 

State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rurai/Small Town 

State 

Nation 



Percentage and Proficiency 



27 < 2.8) 
211 ( 2*6) 
22 ( 2 . 6 ) 
210*2;5) 



27 ( 310) 
223(2*9) 
19*3:6) 
221 *217). • 

• 28|it)t ; 
: :194*&j)ft 

m'mmm 

/ 1 92 { 3*2) 
W(49) 

: 

: '281<I6;1)^ 
' 196*37)! 

imfm 

mm, 

'4'3 0,{SA) ; : 

: 201* 6.4)1 
\32§3ia§t 
203 ( 3.2) 

::,:.217i4l6)l 

19(3.2) 
216 < 4.4). 






31 (3.6) 
201 (15: 7) 
21 (2.5): I 
206 ( 2.8^;: 



27(3.9) 

:220.(-3*5)«r 

18 ( 2.8) 

220 ( 3.1) 

*9 ( 5*9) 
183(5.6) 

34 ( 4.B) X / 

^182*-2l7)l : |j 

32*5^111 

175 (153)M 

23 (•'3r4);tl: 

186 (4.1) 



32*47)"' 
: -213('M)^ 
17*5,8)1 
, 215 (5.4)! 



£ . f 

% j> r ' "/< 

40(7.9) 

iUk . 194 (7*6 pi 
'*$$ 19 (32). A 

188 

ft • 33 3 

!ft& 203<12L5)1 i 

!iS-r:2i4('32);j. 

'W U. v 4* „■ 

•^5(52) s 
. 203*316pi : 

20 ( 5^11 

21 1 * 5:6)1 F 



26 ( 2.8) 
207 ( 3.6) 
20 { 2.4) 
1 218 (.2*2) 



23(2:9)-: 
221 ( 3:2} 

. 20(3,0) 
224 ( 2:2); 

pi189( 4.0) 
18(3.1) 

::;i.197:(:3J^t 

20 ( 4.8) 

~ 

' ; 18 (3.1) 
205 (6#| 



19(2.0) 
208 ( 2.8) 
: 21 ( 2 . 0 ) 
214(1.9) 



21 (3.0) 
v 'li222'(.27) ' 

It^fc20:(.2:1) 

225 ( 1,9) 

MS|i:'l6(22) 

183(4.2) 
23(3:5) 
191 (34) 

f t *'<> - : 

i^l ; :20(3.5) 

24 ( 4:3) 
(3.3): 



: : 



> £/ >> V\* 5 t */&*,' 1'. 

! ::3* 

197(7.5)1 , . 

I - T7 (-4.1),;. , 'U i r-22 (4i5) : 
206(3.5)1 203 <4.f»t . 



28 ( 4.6) %m 
.-214 {<5.0)1 ftl 

223 ( 3:5)1 

3Sl* $00 

206 ( 4:6)1 ft 

M 

220 ( 3.2)1 (I 



1216*5:6)1: .. 

22C2,8)M 0 

/223.(:2l6)l:l|p 

2^(i4Sp::=f 

- 210(3.0) . J 

16(3.5) ft 
f 216*411)1; r* 



47(3.3) 50(3.6) 

215 ( 2.0) 212 (2.4) 

58*312): 58*3:0)ft 

218(2*2) 216.(1*5) 



51*3.3) 
224*i$)|i 
61 *3,9)- ; 
224 ( 2:3) 



• 53*4i4):i : 

225 ( 2.1)' 
62*3,4)1 
223(1.9* 



40(5.0) ' ftftft 45(5.1) 

Mmm^mBMQ9l(0ig 

V 46 < 4.8) 5 s 43 <4*1)1 

195(3.3) 187(2.5) 

53*:6;7) ft , 

: 192*8:5)* ft 

'54*4^1 

204 



48(5.3) 

.' ; i94*5;5)r 
: : : 53*4$p 
• i192 ( 3*0)' 




: 37jppli|'SI W’Wmm 
• ?^2dl:IPi)W .ft : ;j^>8;p9)S 
- ft fit ft >■ ft 59 *s*)tl 

' 21i:*3:^Pftft . '210*218)1 

•ft 51: (5^1 (-5.6) ' • 
222 ( 2*8) 220 ( 3.6) 

P 58(:47)^!l^54*5.0)l3 
222 ( 3 -3)#; ;-'ll^2*2;3)Il 

hmmmffmp. • <205^(1554)1 
l?f ^^pftlft64^i6)i| 
:;-219;(4^|&ft;214.(2.^1 

v l; * :>• •: . *s§? , S' : - yy'* " 
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TABLE D6.2B (continued) 

Public School Teachers’ Reports on the Frequency of 
Using Reading Kits 



1994 Tnal State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



Percentage and Proficiency 



PARENTS’ 

EDUCATION 



College graduate 
State 

Nation 

Some ed after HS 



ll29l(^Ki 

220(4.0) 
20 ( 2.7) 



214 ( 3:4) . 



Male 

State 



Nation 



Female 

State 



Nation 



mmm 

mmmm 

IS' 27 

.212(2.9)1 
24 ( 2.8) 

I2ij6p':6)? 



II 32 ( 3.8) I 

|IV22(2;6)1 

p:rp200;(' ; 3:0)| 

818 30 ( 3J5) * 

IS 208 ( 5 . 5 )?' 

20(2.5) 

iB!212jpi^l 



25 ( 3.0) 
217: (5.5) 
20(2.9) 
225 ( 3.7) 



18 ( 2.1) t 
i: 21 9 (4.5) 

li£Sp.3)^ 



State 




36(5.8) 


23(4.1) 


*' \ 18(3.3) 


50 ( 5.D) 4 


Si*4&< 513) % 






.217 ( 5.3) : J 


mmem 


#*« *)■■ ' 


222(4.5) 


223 { 5.3) ; / 


Nation 


!| : i?26. (sAjfc 


17(2.2) 




20 ( 3.0) 


57(6.0) 


63(3.4) 




: ;v220(6.7)!> 


214(5.9) 




221 (3.7) 


222 ( 3.7) 


224(2.9) 


HS graduate 








l 






State 


P; 26 ( 3.5) ;! 


36(4.9) 1 


18 28 (3.8),' 




46 ( 42) 


42 ( 4.6) 




: il203?(.'4i1) r' 


197(7.9) 


il 200 ( 4.0) : 


207(4.8) 


•: 208.(32};, v 


198(4.6) 


Nation 


20(2.9) 


'24,(34 M 


I tii 20 ( 2.9) 


22(3.1) 


:4v?60 ( 3.8): ' 


|l|l^l(:il9^lll : 






II • .204:(!4.1)'l1 


i 


208 ( 4.5) 


214 ( 3.8) 


208(2.6) 


HS non-graduate 












- ; ■ 


State 


25(4.6) 


35 ( 6.9) 


1 1 29 ( $2) ( 


20(4.0) 


46(5.3) 


44(62) 




ip 




rn 




202 ( 5.6) 


192(4.8) 


Nation 


f . ..30 ( 5.3) n 


r / 25 ( 3.9) " 


mmmsm 


18(3.5) 


Ji54:( 52) ' 11 


58 ( 5.5) 








~*r.v 


liiBiiiP \ v 


199(5.6) 


186(3.8) 


1 don’t know 






X ' v < 






4 >: ' y: : 


State 


iSRtWSi 


30(4.1) 


27 ( 3.1) 


18(2.0) 


l#if 3.6) 


51(4.0) 




204 ( 3,5) 




201 (3,6) 




||208:( 2.6). II 


206 ( 2.6) M 


Nation 


SS : 24<l2.8)-I 


21 (3.0) 


19 ( 2.6) 


22(2.5) 


^*5t{3.4) M 


: 57 (3.5) ; ; 




B 204 ( 2.4)^ 


ffl . 198(3.7):^;/ 




207(2.9) 


|§2l2:i{ 2.3) ■>; 


208(1.9) 


GENDER 


ip/ V ■ ' . 




1 


I | Jj; A ,;/ v , % 'i 


. 'M 


V ^ f 1 




203( $$lN 



209 (5 



mm{ 2.3)1! 



1^253 ( 2.8): 
21 ( 22 ) 




54(3.7). 
I 222 ( 3.0) 
60 ( 3.1) 

Ii226r(rf^ 



iiffipiis 

tRg5$P:$£ 

^5:^1 

. 44 ( 3.4) 

222 ( 2 . 1 ) 



207 ( 329 

■pit 

jjg|gp 

ItcSi^C 
SteqSgi 
ippip: 
Si&Klli 





The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

= School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2C 

Public School Teachers 9 Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial Stale Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1992 


1994 


1992 


1994 


1992 


1994 


TOTAL 






Percentage and Proficiency 


35(3.7) ; 





State 




illfiiiillilt 




20 ( 2.3) 


32 ( 3.6) 




207(3.0) 


111204^4.0), 


:::I217( 2.4) : l8f': 




213(2.8) 


|;il2io(-33)ifi! 


Nation 


i 25 ( 3.0) 




8«l23!(^i)illl 


11 22 ( 2.4) ft 


■ li52:{ 3.8) fig; 


li;|55 < 2 rrm 




212(2.4) 


i 211 ( 2.4) 


216(2.6) 


iiiiliiliil 


218(1.9) 


213(1.5) 


RACE/ ETHNICITY 






jji|| mi: 


White 








HHIPHiR 




: 


State 


31(3.8) 


39(4.6) ; 


32(3.6) 


liag(2:7)t^- 


11-^37 (4.3) i-il 


38 ( 4.9) 




if* 223 (2.4 )^m 


. 224 ( 3.4) hi 


223(2.4) 


223 ( 3.2) ; : 


223(2.4) 


223( 2.6) j# 


Nation 


21 < 3.0) 


^123^2^: 


f y - :26 ( 3.5) lift 


23 < 2.7) 


53 ( 4.3) 


HO: 54 (:3.2} ' 


Black 


JIJ221J2.3) 


222(2.3) 


221 (2.7) 


226 ( 2.4) 


224 ( 2.1) 


222(1.8) 


State 


46(5.4) 


51 m <-4^)VSI 


=!• 21 (3.5) 


16(2.8) 


331(5.3) : 


26 ( 3.6) 




189(3.5) 


( 45) M 


201 (4.1) 


.1:193(5.5) 5 


i|!!l97i( 3.3) i: SI 


'^484(4.4) 1 


Nation 


42 ( 5.2) 




IliiB^^i):llll 


li|ll.5:(; 3.5) i ! 


42(4.7) 


57 ( 5.2) 




194(3.1) 


184,(3.2) ;g 


193(4.9)! 


,;189(.64)!§ 


:^ ; : 194( 3.1) ••§ 


187(1.9) 


Hispanic 








f * 5 \\v- 


F' ' '* '■ 


State 


45(62) 


60(4.7) 


IIS|4 2),W 


16(3.8) 


33 {6.2} 


24(3.9) 




ptr ‘A 1 


f::i84(8.i).S' 


mmr?) - 4 


“ *r*+^?* , r 


'y •***#■ . 


rn :: 


Nation 


28 ( 62) 


26(4.1) 


Mpai2i7)i* 


22 ( 3.7) 


54(7.0) 


■52 ( 3.8) > 




; ; :203 ('S:3)f , // 


187(3.7) 


>£•197 ( 5.8) 1 


197 ( 6.0) 


JJ'202 ( 2.4) ; 


190(3.3) 


TYPE OF 


§ ' * 










LOCATION 




1':' '"I'fJ , 1 >§ | 










Central City 










mmwhh 


y.K < 


State 


68(8.8) 






lllSW^X; 




Ifis ( dlpll 






196(7.9) 






,, ;;; , ' ^ / | 


U 


Nation 


##7<6J5) ;; « 


fl 22.{ 32) § 


20(3.6) 


26(3.8) 


43 ( 5.6) 


52 ( 3.8) 






•:t202-< ; 4.2} ; 


207 ( 4.0) 


215 < 4.8) : 


209(3.4) 


201 (2.3) 


Urb Frng/Lrg Town 








/ , 




State 


lf!;83r(5^ - : : j 


\ :m vksj'h 


sac 4.or : \; 


iilll 3>8)SP 


^;3T7<5^'® 


29(4.7) 




ri 


Wsaz&2y:i 


220 ( 3.6) S 


221 (4.9) 


216(4.0) 




Nation 


§>.22(4.6) ' 


i^li2:{:3.7)i^ 




23(3.8) 


-ii «0C5.1)' S # 






' ^ai8 < 4.3)1 




;':t21B<4J2) ; ; 


| 222;(,3.5)f:f§ 


,§222 ('3.1>7 


fl222;(:2.1)ga 


Rural/Small Town 








III pp^l|^ i|i|| 




ffi-lf : r : f 


State 


ll®S(4.$) i| 


llilis^lll 


32 ( 4.9) 




44(6.0) 


39(6.4) 






Ilf 198 ('3.5) ill 


: 215 { 3;5) 


>:2b7{3.3},/'! 


210(3.7) 




Nation 


MM**) < 


HB30 ( 5.5) -IS 


w.; i 


ISl13i(^|p 


|.1!5p;( 7 . 8 ) . $ 


iPiiiiiB 




; :212(;3.5T' > 


"ih^l5(;5.i)-; : ;# 


fp20 ( 4:4)1 '' Vg 


M217(54)r* 


,/219.( 3*2) ?;& 


. .212(3.0) 



(continued on next page) 
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TABLE D6.2C (continued) 

Public School Teachers 9 Reports on the Frequency of 
Using Computer Software for Reading Instruction 



1994 Trial State Assessment 


















At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 




1992 


1994 


1992 


1994 


1992 


1994 










Percentage and Proficiency 








. . „ .. 




v 








.. «.. -vwyjy- ;• 


. .. r .... 


PARENTS’ 






.. 


f> M&py,. •• •/; 


^1:.^::, ‘ .. 


-i- 


rpi^. •• 


EDUCATION 






s- . • ■ 


■ '.:p - i J - *:■ 


i;vp v .;itj PSiWpM: 

r.-ly.t y-i ■ ■ 




yp r ; 


College graduate 






p V 


%■ •' 


; - .; ; v • ; ; 8fV; 




• • - 1 1 ' . - ■ > • 


State 


38 ( 42) 




49(4.7) 


281(313) 


18(2.3): 


35 (kl) 


33 ( 42)'- 




217 ( 3.5) 




^ 215 ( 47) 


226 (:3.1) 


, ,rv227 (-3 - ■ 


222(4.3) : 


220( 4.5) : - 


Nation 


25 ( 3.5) 




In 22(2.1) 


:;;23p3:5 ):-m 


23 ( 3.0) 


:sa$fcab t ;■ 


: . 5513,4) ; g 




221 (32) 




1:220(2.8) 4 


223f(:3l1) ‘ ' ■ 


:;;230(2^|i:;:. 


; 225. (p;6)> •- 


222(1.6) 


Some ed after HS 




• t 


*; . ‘ 










State 


33(5.4) 




43(5.0) 


27(4.7) 


25 ( 3.7) R % 


39 ( 5.5) . 


32(4.4) ] 




206(7.3) 




214 (.5.4) : ' 


■ -^(v # n .... 


:\y> 


219 ( 5.3) 


• :223(5.l)hp 


Nation 


I423?(,3.4). 




lfc-^23 


v26?<:3:2).^i 


|fti|;23(::3.4)p4 


: : 51 (14.9) p 


54(3.6): 




: 214 ( 4.9) 




!|-219(5:9)f 


2261(44) 


:224 ( 4:9)jp;-;. 


: 223 ( 3.8) : 


222 ( 34 yp 


HS graduate 


• • •- } 














State 


38 < 4.3) 




f: 53(42) 


25(3.5) : 


; • ■ i8( 3.o>i^ : i 


36 ("4.5) 


1:29 ( 3.8) ^ 




197 ( 4.4) 


■p 


P 198(5.5) 


209 ( 3.8) 


207 ( 4.8) 


209 ( 3.4) 


•200 ( 44 5 


Nation 


• 26(4:1): 




25 ( 3.0) ; 


•• <201*121 


WM7{2S)^ 


" : :-54(l4.7)^ •: 


58 ( 3.0) ; 




209(42) 




p 207 (3.5) 




p 206 (4.6)1 . 


• 215 (52.8) ‘ " 


* .208 ( 3.2) : P 


HS non-graduate 














. ijv-. ' I '.’M 


State 


38(5.8) 




fe 44(5.4) 


26 :( 5.0) 


fp::24(4.3)fi ;; '^ 


35 (5.9) 


::'32(.5.1):m^ 








ift 179 ( 9.Q) ,* 










Nation 


34(5.1) 




®^:27 ( -42) ’ 


: ;22!(i3.5)11f 


1P|18^ k 3^1pk 




P, ;55^3.8)P# 




195 ( 6.5) 




190(102) 


*•"*£»*, :*^ . 4.' 1 




199^J3) : ? 


; y186 ( 4.6) 


1 don’t know 








• • p- 5 ' ' " ’ : ' 


. • • -‘'i M- : 




A ?• : - - i' % 


State 


37(3.8) 




fir .46 (4.0) 


29 ( 3.4) . 


Jil;22 (2.4CH : 


34(4J2) 


r : 33 ( 3.8); .:f 




202 ( 32), 




f : 195 (<43p - , 


209; (12,9) . y 


206(3.8) 


r 205;(li3.3) 


*. P204 ; ^34:::!ii 


Nation 


' ^24^(.3:i) 




sp 25 ( zmt :i 


^ 25 (3.1) ; 


m&22( 2:5):itP 


51 (4.0) 


;,54:(-24^-M 




206(25) 




ft: 204 (3# ■; 


210 ( 3.4) 


: :P210(2.4|-1 > ; : 


213 ( 2.0) 




GENDER 






Vi; .. pL. 




iu.- ’• ' • • 




:>p .1 y£h&: 


Male 


• -- 


"Ji 




[. ; 


■ ** 


/ ,y: . 




State 


^i38: : (.3:9). 

■ ■ o/tc?/ ft 




|§ :'r47 ( 3.8), 

<• "4 on f A hV ; 


•/ >26^2.7). 4* 

• r o Ti 


:|p2T (.24)11 : : ;1 

^ 2flO / 


... -36S3i8): ; - ; ; 

210 fl3 OV : 


C# p32 .( ; :3.3)| : i^ 
fir 204 ( ; 4^ ifiil 


Nation 


400 

24 ( 3.0) 


•f 


% 25(2.4): 


' 241(32) T' 


21 (2.4) 


|.W .\SWxVJI 

52(f4.0)l 


; p35(2.8);1f 




208. ( 3.1) 




.8 204 ( 3.1)! 


212 ( 3.3) ; 7 




214(2.1) 


, ;g07<taj^ 


Female 


i ' 




St'- '• • • 


■ * * 









State 






§bl8 


30 X 3.3) : lli 


n / O QN . : 


; :.v : 34. : (?4ip). : : • « 

21 7 f 3 21 


:rp33 ( 4.1}jS 


Nation 


-ZU9 X 

' 26 ( 3.1) 




. 23 (24) ; ' 


4 i-., 

22:(24) 


: CjGAJ \ 

" : $r23(2:5)r; ; / ; 


4U I f \ Wxfej 

■ 52(5.8) ' 


• • ♦'W fMKvj 

55 ( 2.7) ,r: 




216 ( 2.4) 




fi; 218 (2,1} . 


221;|(:27) J 


^:222(2^|;p:; 


222(2.1) 


219(1.5).^ 







. ' > : r j? 


«V# 'P ' • • ' r', ;; Pp . 




SCHOOL TYPE 


• : : ' f *' ! 




• S' VicPfL* : f 


Public 


' ,fV - « - ' -tylf "i 




- . ; f-y?) . * ... : ; ?•; y- : >■ •" ' 


State 


= (==.=) ff 47(3.9) 


: nlp-'20 


«(^) : • ,;:-32(3.6) , ;-t: 




==(==:=) ,4{|; 204 (4.0) , 


‘ S^i'215 ( asygjr 


= P2t0(3.5)£:* 


Nation 


. ■ ,^ : (==;4>««t:v24 < 


■ ^^22C2A)m ■ 


f 27)111: 




=== (— => yi : ';2T1 (214) 


=#1^==) 


— - ; ::V 1'{2i3ii:4Si| 


Non-Pubiic 






• . \ 


State 


= (==^) fr 13 (8.5) 


— i(=^) 21(11.8) 


=-(^=) : . 66(16.4) r ’i 








:232(7.1)JP: 


Nation 


13 (3^r)! - i 


. .M'V 15(^fP : 






==i= (==.=) ■% 230 ( 5.5)1 ' 


: p^34(4# ; 




Combined 


:S : *' 






State 


==(=.=) !f. 45(3.7> 


===== -i: 20(2^): 


== (=.=) -35(35)1- 








==(—=). ,r 213 (3.i>r'i 


Nation 


:S ; <S) 


===^i^=) '^y2i f2;8):|-r 






^ === (=•=) : . 212(2.1) 


=r=rr(t=r.=) 220(2.3)" 


==(^.=) .’'215(1.3) 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

= School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2D 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial Stats Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



Percentage and Proficiency 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 
LOCATION 
Central City 

State 

Nation 

Urb Fmg/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



!t79 ( 2.6) 
213(1.6) 
65 < 3.1) 
1217 ( 1.8) 



ii: 80 ( 3.0) 

1 1224(1 

37H 
f.22f( inf- 
ill 77 ( 36) : = 
Sit 96 (2:7): S 
if 62 < 3.8) : 
jj 193.(2.1) fj; 

~192f 67)f 

|iij| ' ' : || : ff §| 

83 ( 6 4) 
0201 <4.8)S 
Si69:(44)f? 
I 208 (:2J yif, 

:221.(22>;fi 

212 ( 22 ) 

ii5f:(t6l9)P 

220(42) . 



75(2.5) 
211 ( 2 . 6 ) 
75 < 22) 
B214( 1.4):i 



:»!f 75 ( 3.0). 
1 ; t ' *225 ( 22) 
Hgf f.75 (,2.B): 
; || 223 (1:6) 

mm (3:7) 

ff;i188(36). 

Ifllr'TO ( 3.8): : ' 

186(22); 

Mi 

iSr^(6:i);? 

Iii;i9i pTji 



i:^lS86(3:6)-' 

11:203(46)1 
i§t§167 ( 413)f 
204(32)|' 

K 

Ai217(4.6)| 

i|lli8d^:3i)l 

gg219(j2.0) 

illSIfeil 

1^1206(3.8)'! 

^1^75^5^3)1 

PI|215^2I5)I 









17(2.3) 

207 ( 4.6) 

26 ( 34>K 
216(2.3);-i x . 

•• f ,f || | 

17(2.6)^ , 

' 2!S’(4^ : :f, 
f 26( 3.6)f ::: : . : : 
222(22) 

SpslllHIf 

; ;28(3.9)t|M ' ’ 

fjl95(4.3)* \ 

liiillMlilS 

203(6igftf 

•';f »£ 



18 (2.0) 
201 (42) 
21 ( 12 ) 
214(2.4) 



f 18(2:4) 
219(32) 
lf21 "(2:3) - 

225 ( 2.4) 

'180 ( 5:3) 

• 21 (2:9) 
187.(3:3) < ‘ 

mm " 



i^4;(|62)| 

p; '•,**’* 

V 21 (:3'3>f 
f 208 (4.0) 

?M(5(2S)f 
; ;2Q8 (72)1 

v 'f'28-( : 3.7>i: 
219 (2^f 



<M2'0l(26) : ;f : 


1^7(22%; 


186(42) 


z f* ■ 


i-f 


IW-Sl 




?r : ! 2 (i .6) 




immm 


, 27( 3.9) 


10 ( 3.0) 


205 { 4.1) v* 





!3;.:gfp8(2.9)'?^ 

:l;#;r204(82)lf: 

ill: ':226-:(i2:3) • • , 



? 22 ( 46)1 f 22 ( 3.7) 
f 210(6.4)1 ?fl 206 { 3:9)1 

218 ( 42H i? £• 213;<6.3)T * " 



4 ( 1 . 1 ) 
. 200 ( 8 . 0 )! 

9(1.5) 

210(3.3) 



’ 17(16) 
201 (5.1)1 
,15(1.0) 
:r208 (3.5)i- 



.'" 1.1 



ifiTSCV) 

>.:-.-J5:(4.7) • , 

5 ( 1 .7) 

'':-f10; : (.'2.6) 

lilSBlife 



■±mt m - ' 

214 { 5.7)! :r= : 

l ;; 

216,(4.4)1 t 

V f P\< : 1' f>. =1 

8(32) 

i;;?t;.i83.( 6 m3 

P-IM9>(2.0)' ::•■ 

191 (4.1)1 

'lV3(14) 

| p ft: :**♦;■:£** 4^ :^p| 

fill! 



f if 6(12)-; M: 
5(2.3) I": 

MS (8.8)1 t®8 202(5.0)1 

•?- ff2 ( 2-0) 

• ■ 209 < ss)i aoo ( eaMI 




(continued on next page) 
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TABLE D6.2D (continued) 

Public School Teachers’ Reports on the Frequency of 
Using a Variety of Books 



1994 Trial State Assessment 



At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 



Percentage and Proficiency 



PARENTS' 
EDUCATION 
College graduate 

State 

Nation 

Some ed after HS 
State 

Nation 

HS graduate 
State 

Nation 

HS non>graduate 
State 

Nation 

I don’t know 

State 

Nation 

GENDER 



mo$3XS0t 

223(2.4) 

b 

225(2.3) § 

67 ( 4.3) 

221 (2.9) 

n { 3.i> 

205 ('2«4)/ ; 

63 { 4.4) 
213(3.1) 

!l8®3^8il 

204 ( 4.0) 

• -65 <4'.7)'i / 
. 199(3.8)::-: 

77(2.8) 

206(1.8) 

64 ( 3.3) 

211 ( 2 . 1 ) 






222 ( 2.8) I 

ig22^|1:5 ),•; 

75(5.0) 

il:i223lpiS):0r s 

11 

221 (2.9) 

72(3.1) 

198(4.1) 

II 70(3.2)/ 
205 ( 2.2) 

71 ( 4.7) 
187(6.3) 

71 (4.5) 
185(4.6) 

203 ( 2.9) 
75(2.4) 
206. (1:7). / 



Male 



1 : 1 6 ( 2.8) 
f 214( 6.1) 
: 26(3.2) 
| 224 (ZA) 

: ^ 4 



19(2.5) 
208 ( 4l9) 
19(2.0) 

17(3.4) 

I 

224 ( 4.8) 




mmm 
imms® is 

21 ( 22 ) 
206(2.9)4 



State 


79 ( 2 . 8 ) 




WfWmM 


19 ( 2 . 1 ) 


||;/=5 


<m. il 


7 ( 1 . 7 ) 




liit 2 :Pi 9 )Ig 


I /205 ( 3 ^}::' £ 


202 ( 5 . 4 ) 


195 ( S; 3 ) ' 




II 


191 ( 6 . 1)1 


Nation 


Iil66 : ( 3 . 3 ) || 

- : / 213 iW&%SS 


IllgjiPiPH 


4 SS 3 -.- 


'i g^ 0 (i. 9 )!i:i^ 

;:^/207 (’ 3 . 3 ) * 


SB® 

f |204 




li) 

203 ( 4 . 5)1 


Female 


XT 


[ri * “ * : 




‘ 8 ^ ' f 


i ■ : 


• • - J -*'i' > / 


State 


#i 79 (& 7 )'S 




mmmmm 


18 ( 2 . 0 )' * 


|ft /3 


( 1 . 0 ) || 


iiBpifil 






■St |{2 3)ft 


^srnmmm 


1 C 207 ( 4 , 4 ). 




r^)/K i 


210 ( 6 . 3)1 


Nation 


65 ( 3 . 1 ) 


74 ( 2 . 3 ) 


Mmt 3 .o)f | 


^21 ^ 2 ; 0 fl|j 1 


/’■»! 


iiwi 


: 5 ( 0 , 9 ) 




: / 222 p. 8 ) 3 ;: 


219 ( 1 . 6 ) 


218 ( 2 . 6 ) 


:;;/ 220 xa 3 ) *4 




214 ( 3 . 4)1 



21 3( 1:1),: 

*** 

7 (1.4) 
213(5.1) 

Wi a 

1140 ^ 13 . 1)1 

4(1.4) 

IKSjm: 

iMO ( 2.8) 
7(3.0} 

mmm 

IllS ( 2.6) 

liliiil 

-tm 

j 

204 ( 3.4) 



1-iai 

ji 5{f4«)V; 

215 ( 3.9)1 

ft 8 ( 3.2)18 

*8 r:*) 8 

4 5 < 1.6} 

"* (" ‘J 

10 ( 2.3) 

- r .*) 

44 402) 

■Illilll 

9 ( 3.5) 

-r* 

feaS(0.9) 
ill 98 (6.8) 

/ 

it :''K'\ 




The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

= School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.2E 

Public School Teachers ’ Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 










Percentage and Proficiency 






TOTAL 












7 


State 




70(3.0) 


22(2.6) 


22(2.6) 


8 ( 1.1) 


6 ( 1.2) 




213 { 1.9) 




■8l21;1i!{::3l^||i|l| 


205(2.9) 


li : 207 (!4?1 


197(4.0) 


Nation 


56(2.5) 




30(2.5) 


22 ( 2.0) 




mm i-6) 




218(1.9) 




213(2.0) 


2102.1) 


217 ( 3J2) 


<^212(3.9)7;^ 


RACE/ ETHNICfTY 












- 


White 












- 


State 


72(3.3) 


71 ( 3.3) 


21(2.7) 




8(1.4) 


8(1.5) 




223(1.8) 


S6(2.Q) 


225 ( 2.3) 


: • SI ( 3:0) % 


219(5.3) 


ti: 2 \ 0(3.7) 


. Nation 


55 ( 3.0) 


69(2.6) 


4 : 30(3.0) 


W 23(2.3)' * 


15 ( 2.8) 


9 ( 1 - 9 ) 




226 ( 2.1) 


. : 223;c|i.^ 


219 ( 2J2) 


S3 ( 2.4) 


g221^3#:-:j 


SO (4.5)! 


Black 














State 


M 66 { SjO^SI 




l| • 24 ( 4.7) " 


ililliili 


10(1.6) 






71193 { 3.3) 3 $ 


IS 187 ( 4.1)! 


' i 182^3:0)! -IPs: 


li 185 ( 4.1) ; 


^183(3J9f' 


: 'T8i( 5,1)1 


Nation 


59(4.0) 


;r 67 ( 3.9) ; 


31 (4.4) 


Il:i24i3.1)i^l 


10(2.7) 


i!7£(9(;2^ 7 




193(2.3) 




193(2.9) 


J:18S{:3J5) 8 | 


201. ( 5.1)? t 7 


192(5.4)1 


Hispanic 














State 


74(6.0) 


71 (5.1) 


20(4.5) 


l||:23';(4.i) ® 


6(3.1) 


: 7(2.7) 






^160^8^0)^ 




'^♦ir ; 


*+* »|t* *y 


*•* r *) 


Nation 


58 ( 3.4) 




^: 27 ( 3 * 4 fS 


foii^syill 


^15*2£) : '! 1 


8 ( 2.1) 




,r 


||M89'(2.8)|..:: 


;P2b2(3|)fi||i 


j 7*195 { 5.0) i g 


203(4.6) 


189(6.5)! 


TYPE OF 










'1 ' ' 1 ^ 


; i v!: 


LOCATION 








8 81 . . | 


7 'S', r /K' r * ' >1 


\ s i 


Central City 






? - |§ i 


, 7 8 ' 3 £ ? 8 t|; 


: . 7 v' ^ ' ' 


\l;l' 'j 


State 


W 


74 {VJT ^ 


WiXwMm 


ry 23 ( 7 hy y 8 


' 7 -; 3 (2.0) 


till 3 ^i#ll= 




lililpilllli 


11198(5.1): 


. • •• • Vi*| ^ . C'~£ i £ 


'If fo 




¥mh 


Nation 




Iil7i;3i)lll 


:} 8 S§Ci®^I;:j 1 


i 24 ( 2J8) | 


“ 10 (a 7 ) vM 


illl 9 {^ 5 ). f 




®^ 09 < 2 4 ; ! 


7204 ( 2 . 6 ) /; 




208 ( 3 . 6 ) 


-' 212 '( 3 J 3 ^^ ^ 




Urb Frng/Lrg Town 






^ ijHVf i* : £ 


'^i^' J i Jri* /,?> ‘ v 41 


■;! ; 7 '= 


'' 


State 


74 ( 4 i)^ 


|tfe? 7 ^ 3 . 6 )' 1 




18 ( 3 . 4 ) 


8 ( 2 . 2 ) 






" 220 ( 2 : 7 ) *-'¥\ 




■ 221 ^^ 6 )^: 


211 ( 519 ) 


204 ( 6 . 4)1 


. *** 


Nation 




lll ?0 pi# ■>. 


- 29 ( 4 >) VI 


'Vijte'psa#^ 


3 . 2 ) p 


7 ( 2 : 1 ) 




222 ( 3 . 2 ) 




;,ai 8 (Z 9 )i^n 


7,221 < 2 t 7 ^; £ 


222 ( 5 . 8)1 


: ^ 22(^1 'i 


Rural/Small Town 




• -I'll 










State 


' l s 




27 ( 4 . 5 ) ! 


25 { 4 , 1 K'? 


€ 12 ( 2^7 


iiim 25 ) - 




;t 2 f 3 i( 2 . 6 )/ 1 i 


.209 ( 13 l#|ff 


;|I 2 C®.!( 3 . 4 ) 1 . m 


Ili^l : 3 ^)llll 


204 ( 5 . 3 )! 


197 ( 5 . 5)1 


Nation 


li| 56 W 3 i)i|ll 


, ; /: 


:^( 4 , 7 if 7 


21 t& 2 )/ f S 




10 ( 3 . 5 ) 




mmmxm- 


215 ( 22 ) , 


' 72 T 4 ;-< 4 . 5 )i 


' 8-210 


214 ( 411) ' 7 ; 


209 ( 5.6)1 



(continued on next page) 
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TABLE D6.2E (continued) 

Public School Teachers 9 Reports on the Frequency of 
Using Materials from Other Subject Areas 



1994 Trial State Assessment 


At Least Once a Week 


Once or Twice a Month 


Never or Hardly Ever 


1992 


1994 


1992 


1994 


1992 


1994 










Percentage and Proficiency 






PARENTS' 














EDUCATION 


• . 












College graduate 


IkisiS^is: ''' 7 












State 


it! 72(3.5) fA 


U; 72 ( 3.0):; : i 


20(3.0) 


22(2.8) mi 


8 (1.4) 


iff 6(1-2) 




222 ( 2.6) 


220(2.9) 






212(6,1) 


206(7.1)! 


Nation 


v:.;-59t3.i ) -K-1 


69 ( 2.5) 


27(2.7) 


23 < 2.2) s 


: 14(2.4) 










220(2.9):®]| 


224 ( 2.8) 


224 ( 5.3) 


:: 222 ( 4.4)! 


Some ed after HS 




a $&>■■■ |: 


' '' . ~ > ~ y . 




w ' : . v "i , 




State 


65(4.4) 


- '71(5.0). 


f-:29 (4.0) "U 


•;|h.22.i(4.4)-i;E 


6 ( 2.0) 


7(1-7) 




215(4.3) 


|:^0:(!34§lf 


, .• ,,r 5; 


a#**; 


(■*■*> 


^ r .^ .. 


Nation 


55(4.3) 


: i1^i70;(.3.4)'l 


35 ( 4.4) 


23(2.8) 


11 TO ( 2.4) £. 


:t ;. 7 ( 2.0f; r 




|j[ 224 (3.7) 


| : /:^;(;2.6)t3| 


219(4.3) 


221 (4.9) 


*** 




HS graduate 


•' V ' 












State 




1 8ISS 4.3) 


21 (3.4) 


I1 1-25 (134) ' l| 


8(1.7) 


9 ( 2.1) 




205(2.7^(11 


W&fci ( 4.4) 5 1-:1 


204 ( 4.6) 


i J 198 ( 6.4) v ; -' 






Nation 


56(3.0) 


Iflil '66 ( -3.1} 


26(3.0) 




2^7)' 


8(1.5) 




213(3.0} 


207( 2.1) % 


209(3.6) 


, 205 ( 5.0) 


. • 215 ( 4.3) J 


217(4i) 


HS non-graduate 


' S''-' Vj 


1;?'- hr ? & 'A- 


* ''' 




,-w 5‘!* 




State 


8|§Ri 5J2) 




iteS&tSS) ■' 




9(2.1) 


13(3.9) 




203(4.1) 


186(8.4) 


- 




, ^ ♦J" 


?7*l lK***7^** 


Nation 




Ii;r66<4.3)::J|i 




23. ( 4.2) 


: 14 ( 3.6) 


3B 




li95i(2.9)::it. 






xWS0-r§ 


*** 


*»« 


1 don’t know 




;; '*7, 1 






** - ^ s 




State 


70(3.3) 


70(3.3) 






^!8(1.3).!j 


9(1 .5) 




207 ( 2.0) 


11203 (-3.4)' m 




Ffi95-(:3JB)' : '-:|| 




188 (5.0)11 


Nation 




l#|®ro3 


32(2.6) 


;.®2Q(:2.4):.'t : 


15(2.8) 


11-10(4.7} l; 


GENDER 


H 2-33;.-^ 


205(1.8) 


*2i^:&8)Si;l 


; -208 (:2.4);;|h 


mm i^3) * i 

i , j ' 


202(5^) 


Male 


f ' ;-j ' 


C'4 pi! ' .5 


ligf|: : V 




" v x v , A :.-:' 


i : 


State 


# 69(3.i) 




22(2.8) 




9(1-2) 


8(1^) : 




lllTl( 2.2)' 


205 ( 3.7) 


^208.(&7)®*1 




*38203f<4.7) ' : 


mm&£i ss) 


Nation 


®|§7f( 2.6)' *4 


J| ? 69 ( 2.3) h I 




mii22i^2.0)«| 


aiS3!p4)'m3 










209 ( 2-2) 


: r-206 (;2*8)i '" : 




208(4.5) 


Female 


f'',X '-i. ' 




oh v l:.:.:'/ 




4 r'7 




State 




69(2.9) 


®liif('2.8) / ; £ 


iiii(2.6)i| 


7(1.1) 


11 




215(2.2} 


fi£i5.:(&$iil 


®'243-(3,4).-Si 


’^ J 2l2 s ( 3j3)/ * 




l!|20l::pi8)iiii: 


Nation 


§*155 




30(2.7) 


18123^1)1181 


!k:T5'(2S)liI. 


;*Jwi4(:‘ 








217(2.6} 


®p2i|( 


Iii2i:®3^ili 


'*K2IT4<4J9 




The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

= School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3A 

Public School Teachers * Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 




1992 


1994 


1992 


1994 


1992 


1994 






















Percentage and Proficiency 






TOTAL 














State 


37(3.7) 




55 ( 3.5) 


53(3.1) 


9(1.7) 


19(32) 




: >210(2:8)>J|| 


ll:139:(iS.8)faii 




I-1210 (2.5): M 


215(6.1) 


216 ( 4.3) 


Nation 


31 { 2.7): If] 


if;:::26i{ 2.6) • m 


48 ( 3.4) 


48(2.5) 


22 ( 2.8) 


26(2.9) 




213(1.8) 


207 ( 2.5) 


216 ( 1.7) 




221 ( 3.3) 


217(1.9) 


RACE/ ETHNICITY 














White 














State 


32(4.0) 


26(3.9) 


58 ( 3.8) 


53 ( 3.3) 


10(1.8) 


: 20(3.7) 




222 ( 2.6) 


.7217 ( 2.8) 11 


1 224(1.6)':-i : 


223 ( 2.3) 


225 ( 5.6) 


230 (-2.3)! ill 


Nation 


28 { 3.0) 


M -23(218) 


49 (3.9) i| 


Ill-49i(i3ib)l?il 




If 29 ( 3.4) 81 




220 ( 2.1) 


220 ( 2.3) 


223 ( 1.9) 


: 223.(1 3)/;. •' 


227 { 3.3) 


224(2.1) 


Black 












State 


% 43(5:4) .11 


fi il 31 ( 5:3) 1 f 


51 ( 4.9) 


S! 52 ( k7) - I • 


6(2.3) 


18(4.6) 




197(3.8) 




193(3.1) 


190(3.1) 


; *++ £♦* 


JI 188 ( 6.7)! 


Nation 


'3sr<4.i3 i 


38(4.8) 




48 ( 3.4) 


17(4.1) 


14 ( 3.1) 




196(2.7) 


.183(2.3) 


192 ( 2.4) 


188(2.1) 


195(4.7)! 


189(4.3)! 


Hispanic 








State 


37(5.8) 


86 '34 { 5.1} : r: =' 


1 <54 (6.2) 


49(5.3) 


9(3.1) 


17 ( 4.5) 




m mmmMS 


H’SKTI (13:1)1, i 


166(6.4) 


>7 192(16:6) 8* 


: **■* 


*•** . 


Nation 


40 ( 4.0) 


tgf 29(3.3) r 


46(3.9) 


7° 45(4.4) i 


14 ( 3.5) 


26(3.5) 




199(3.0) 


188(4.6) 


: 1202 £3:3) ^ 1 


• 7 193(02) ||o ; 


205(5.8)! 


188 ( 4.3) 


TYPE OF 






*. h ' : , !: . £ . ^ **; ‘ I'i" 








LOCATION 














Central City 


\ ? ''7 












State 


44(8.6) 


1^22^6.6)1' ? 




56(8.3) 


7(5.1) 


23(8.4) 




205 ( 6.1)1 


175(6.3)! 




206(8.6)! 


r.‘) 




Nation 






I 


1 >7 .45 {.3.9) . & 


18(3.7) 






!igi|3.o) | 




•>gg>5p.1) 


208 ( 2.7) 


216(4.4)! 


;;|208'( 3.9)1 1|| 


Urb Frng/Lrg Town 






' V/; ' ' ' .f' 






State 


30(5.0) 


— r 23 (<Ws 






14 ( 2.6) 






214(5.0)! 


199(175)1 : 


220 (2.4) 




221 (5.8) 


■:221|| 5.5)1 


Nation 


iiiapijiiiii 




54(4.1) 


46(4.3) 


25 ( 4 5) 


34(4.2) 




217(2.8)! 


, 4:1)1 \ 




|lg|;(l|||||| 


223 ( 4.8)! 


8:224 ( 2.5) v,; 


Rural/Small Town 






' S? - ,M l 


State 


40 { 5.8) 


liiiilillll 


v ;'S6<k7) „ ? 


49(4.3) 




14 ( 5.4) 






205 p.7) ;* 


?! 


204(3.2) 


Wmm7y\-H 


212 (13.1)1 :i 


Nation 


W- ''34(6^11 




>4s;(9;i) y \ 


i;j 57 (6J2) 


'Aisles) -v'i 


20(62) 




215(3.8) 


212 ( 5.4)! 


3.1)t : “ j 


v/215(.2.3)' : 


<223 ( 6.9)1 ; 


212 ( 4.4)1 



(continued on next page) 
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TABLE D6.3A (continued) 

Public School Teachers’ Reports on Asking Students 
to Work in a Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 








Percentage and Proficiency 






PARENTS’ 






. V v! i# 5;C'P'- : 






EDUCATION 


• • C# f 1 ; 


• : . ■ i ; . 




• - 






College graduate 




. V i - 








" .' ’ : "• 


State 


37(4.3) 


23(2:9) 


54(4.1) 


55(3.3) ^ 


. io(2:i)t; 


22 ( 3.7)-^f: 




221 ( 3.9) 


208 ( 5:7) 


221 (2J2):: 


221 (3.5)*#: 


. 223 ( 8.5)1 


;;224:(5.3)$i|i. 


Nation 




: : 24{'2i9) ! 1 ?S 


; :.46-(:3S) : ;:••• 


f, 48: < 3.0) 


: : >-24 (:33)®:iSii 


; ; 28 ( 3.3) 




f«220<2.$1v* 




. 2251 ; :2^)ip., 


224 




229(.2.1)if|| 


Some ed after HS 




\ 










State 


29 { 4:6) 5 


28 (M) ; - • 


60(5:3);;r# 


52 < 4:9)3 


' 11 ( 3.1) W' 


21( 5-6) V> 






; C 


214(5.3) 


219 ( 4.1-)# ; 


■ '***{'*•:•); i-:v: 


—(**.•) 


Nation 


22(3:4) 


23(3.2) 


56 ( 5.8) *: i 


45 ( 3.8) • 


22 { 4.6) «»-. : 


32 ( 3.8) 




217^4 pf; 


220 ( 5:6) 


223 ( 3:6) ; *. 


225 (2:8);| : '.; ' 


22 2 ( 4.3)1 


T 219 ( 4.3)l|!;; 


HS graduate 




• v-‘ : 


Ih 




% 5 "• ' . •'.{ >. | i 


. ■ • ■ * V: : 


State 




in4 fi.'y.ytt \ 


OAC./.ift <1\ 


49:C4:6fl4J 


|;: : -8(;2^i:P: 

<;• • *** ( ## ^) X 5 ; 


16(3.7) 

205' ( 7 «ii; 


Nation 


203 ( 3.3) 

33 : (3i9) '••• • ' 


: • 1 S$A 

32(3:6) : 


20? A ?*?) ; e 
47 ( 4.4) >■ 


•50(3^:11' 


r 19(4:0) (•! 


; 18(2.5) te: 




213 ( 3.3) 


206(3.6) 


209 ( 2.8) ; : 


208 (2:8): | ; i 


219 (4:6)1: 


208 ( 4.3) ! *• 


HS non-graduate 




•/ . . • 


• : iiwi 






: ■!': ' Y& 


State 


37(52) 


35 ( 5:5) 


56(5.5) # 


54:<5:4);: 


•7(24|||j 


■ 11:<3.6):S: 






; - ^ ■ 


202(53):| 


; 190(5.0)^^;: 




1 ***(**•*) 


Nation 


27(4*6) 


.24 (4.7) C# 

•' left AiC'iibVl : fj 


58(5.1) ; 

^ 197 ( 4,1) 


49(4:5) 
193 / 5.5) 


15(.34)ii:i 

+**< 


i: 26(5.0) 

I#ii80i8.73^i 


1 don’t know 










t ! 


1 ' 


State 




. I 30 ( 3:9) v 


54 






: " ' 19 ('32)13: 




202(2:9) 


193 (62) - 


207(2.4) 


201( 2,9) ; : 


. — 


209{4.0):j‘: 


Nation 


33(3.0) 


27( 2.8) r 


46 ( 3.5) r. 


48 (2.9) 


21(2.7) 


26 ( 2.9) f:V 




. 205 .(22) . 


^0(3.J)> . 


211 ( 2 2!) ; ? 


206(ti8):;jj 


217(3^); 


: 21Q(2.3).j||! 


GENDER 


■; ##61 life.:-;. 




; rt 


V K ^|Sj| | 


/• 'ii'i'h'/ 


\v . y . * ifJtil? 


Male 


- : :f f ::• • A 




: '? : illlllife; 


: 1 . fX't 






State 


H::36pl 6) 


. 27 (3:4) # 


■ : -ss^aSi?^ 


54^(3 2):}^ 


' ' 8 ( -1:9) . 


19 ( 3J2) 




•210:(l3ri)-' : :: 


‘flirt ( 7:4) , 


209C2^lU f 


:: 205,( zmW- 


C 213 (67)!^- 


210 ( 4,8 YM 


Nation 


30(320) ; 


27(2:7) 


47(3:8): 


AT (214):^- 


• 23 < 3:o)fir; 


26(2.8)?fS 




211 ( 2v4) 


203(2:6); 


211 (£3) 


208(1.6) 


218(33) ;:i 


• , .213 ( 2.7) Vf^; 


Female 




$ : 




'. • • i'’’ : 


• . |f#. 


i... .. j** • »; 


State 


37(3:9) 


• 29(3:5) 


54#J)i^. 


5i:(3:^||j 




>20 ( 3.3) 


Nation 




206 ( 4.8) 
25(2.6) 


216T'.2^)p'.;- 

; 48*32)11^ 


SI 2l5.(2,6)'dit 
■ 43(2:9)#: 


.219(63) 

'20(2.7) 


B 221 ( 4.5) H 
26.(3.1)SiS 




215^230):- ; - 


*212 (3:0) • 


■222 (;22)-l6 • 


: 2211^7$%%: 


: :225 (:33)ki- : ' 


' 222' (1.6)11 







• ■ ■ ’f 




- . . : , 




y. jy\ y „ f [ 




SCHOOL TYPE 






• ; ; c 






f • ”{"^2 


Public 


'* li 


*’ » '"|dp;S>^ 


• ; £ . 


' '<;£&$■ . 


r?;.;* f II'- • 




State 




;r: 28(iS6i)i^ 




.1 53 < 


. . sssss (ijss-ss) # . ’ W 


;^19(2^||fe 






199(3.8) 








?-216 C4Jjpii| 


Nation 


' K ^ ; 


• 26^2 WfcT. 




48 ( 2.5) 


:' ; s=s±='^== 4 ;r 4 c • 


26 (-23)111 




' . =^=':(==— ) : ' 


207(215); 


(==^y) v r. 


214 ( l Uf 5 


" • ==: (= 4 ^)>;- ' 


• 2 t 7 .(l 4 ) ; ^® 


Non-Public 






=;~# 




• : . " ; 




State 


snss: ( — — ) 


33(134) 


(=s=^s) ; 


55 (153) 


== (sks^):. 


12(8.3) 




— -777 (^7777.'—) ; 




J 55 ss:(ssss^a;). 


237(93)1 . 




r.r^ri 


Nation 


5 = 5 ;(=Si^=). s 


34 ( 5 .6) 


?sss±t; (assess)?. > 


31 (;5.3>^.v 


■sssst (=4^;; ’ 


15(33)#- 




: ; ’• 


•i230;ga^S : 1 


•asgjg^: 


229 ( 3.7)|# 


• : -sssssf 1 , 


' Z35 ( 54)i|| 


Combined 












. • s ? - 


State 




28(3:3) 




53( 3.0); t 


=n= (== 5 S§p- V' 


19 ( 3.6)#: 




— (=^:) 


^Mr 


4=^=7 


212 ( 2,4} 


(=r.~) 


*~CV); 


Nation 


jl— 


27(2.3) 




48(22) 


s=s («=*); ' 


25(2.6) 






210(2.1) 


■— — — {=.—) 


216 ( 12 ) 


===( “^ ' . 


218(13) 



The question associated with this variable was reformatted in 1994. No trend comparison tests were conducted. 

== School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). ! Interpret with caution — the nature of the sample does not allow accurate 
determination of the variability of this statistic. *** Sample size is insufficient to permit a reliable estimate. 
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TABLE D6.3B 

Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 



LOCATION 



Central City 

State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 

State 

Nation 



Percentage and Proficiency 



59 < 1 . 4 ) 
215 ( 1 . 4 ) 
50 < 1 . 6 ) 
217 ( 1 . 1 ) 



57 ( 1 . 8 ) 
226 ( 1 . 3 ) 
48 ( 1 . 9 ) 11 
225 ( 1 . 5 );|.- 

< liip 

l2d0<&8).” 

..- 58 ^: 2 : 3 )^! 

'196 ( 2 . 3 ) 

194i(rS:6)- 

: : 

:2OZ0^ 



■ 

*^: 5 # 2 i 6 )! 

U:208^mi 

fmM" i 

iifsitt mm 

'' 

220 ( 2 : 5 ) 



£153^1:6). < : 

C2t0(2.6) 

:Mli'(.i..3) :• 

.218(1.3); 



( 2 . 4 ) ; ; 

^ 226 ( 2 . 5 ):-,;.' 

■™ 5 ©.;(-.i:. 6 )^?; 

^;ll228:(|J ; ^)ff 

-f;M9H3.2) fi 

54 ( 1 . 8 ) § 

• 1 |;| 193 ( 2 . 1 )' A; 

ll > :;r££ 

• ;;; 55 '( : - 3 : :# :: ': 

188 ( 6 . 2 ) 

50 < 1 . 5 ) , 

? •: • j ; % i£\ :cv; j 

197 ( 4 . 8 ) 

\.%i 






'H ''i217^5f3)? 

lliill^(;i^)l 

225 ( 2 . 0 ) 

58 ( 3 . 0 } 



24 ( 0 . 9 ) 
214 C 2 . 1 ): 
29 ( 1 : 0 ) 
218 ( 1 : 7 ) 



27 ( 1 . 3 ) 

224 (: 2 . 3 ) -:t:l 

; 30 (: 1 J 2 ): 1 > 1 

:J^-20iliSI| 

i 192 ( 2 . 5 ) ip 

sli^apis 



••r-27:(lni )'••••• 

208 ( 2 . 6 ) 

:: ;25 (^ 0 . 9 ) < 

• 215^(11 -.4) : 

1 • 



222 ( 22} ; 
224 ( 1 . 5 ) 

ISM; ( i.6) 

V r 186X4:$)!i 
23r( 1.4)- * 
~ <: 187 ( 3 . 1)11 



■; 29 ; (^%: 
; 20^^ 

1 

210 ( 2.1 fc; 

''''•27 {T M 

fe22li( 2.9U; 

S 2 l: 1 (&$£ 

•3'218?('3J5)^j 



• ••*** r *) 

*'-~W 



si® l|i! S 

27 ( 3 . 0 ) 

r i£^;!<i9i5)liS; 

;^|f 205 (£. 4 )® ;i 

■II# ^4?; 

^^i2l4'(3;9)v 
: ^ 28 ( 1 . 0 ) 
22 i,< 2 : 2 ) , 

22 ( 1 . 9 ) 

|?S:202 ( 3l7)>^ 



17 ( 0 . 9 ) 
203 ( 2 . 9 ) 
21 ( 1 . 1 ) 
210 ( 1 . 7 ) 



; 21 02 ) ■> 

; 201 ( 37)#P 
.24 ; ( ^1*0)i^ 
203 ( i 1 . 9 ) i< : 



• 21 

■ 217 ( 3 . 6 ) M- 

■ ^ 250mm 

11 



• : i:-21 : 3;;(22); 



16(1.1) 

216(3.2): • 

; 22( 1.3) -i: 

i219(2.1) 

^£l6(1.5)4£|lM(1.8) 
&»'( 4.1)^i- i ^ ; 178'e5S)'1 
l8'fl^ J K ;r£^23(;l^ 
||1 83 •( 2:^1 jj||||p !|^6 J( 2 : 8 ): 

1 23 ( 34)^4^21 ( 3J2) 

20 < 



1 ‘lf 

|4|18t24^l?f22ii0W 
84,00 ' t^6)* 

25 (0i£)^S 
-197 (=3|M|; * 






: 203s(}2;54tt|| 

' ; "a ?22 (;1.3)1 . 1 

.,;2ts:( 2.6);::; f | 

■ftp \r--n- r iv:-; s:; 
||20i:(5|J0 i%$r-* A 
*::Z\2 ( 5 4 )-:g| : 



: 2 l;(dl 8 >^? 

v l 24 p&|| 

^ 9 <: 2 f 7 )r^/ 

Sl9:(:ll^l 

? 2 b 3 :-(: 6 . 7 )^" 

;g'24®2lsp 

: 2 Wr( ; 3 ; 6 ) S 



(continued on next page) 
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TABLE D6.3B (continued) 

Public School Students’ Reports on Working in a 
Reading Workbook or on a Worksheet 



1994 Trial State Assessment 


Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 








Percentage and Proficiency 






PARENTS’ 


\ V~ >. ' 7 












EDUCATION 






v 


[js-y ' • 




-77 •••' 


College graduate 


. : • .. 




v; k 


!f|- ' 






State 


V 60 < 2.1) 


-;32 : (:^i)<- 


W 25:(fL7) : lf' 


27(116) V!i 


'!¥ii:(.ii:^) - v - , 






223(2.1) 


220(S;5) 7 


^223i( 2#Ml' 


:;#220 ( 3.7) i 7 


213(5:1) 


:H^2ibi^4:5)':r;' ' 


Nation 


•; J >>49( 2.2) 


53 (4:^4) 


•: '30 (177); 7#. 


24(1.2) : 


:if- : 2i ; (ii:6) 






224(1.8) 


226 (1,3) . 


228 ( 2.5) ip; 


•4226(48) 


Me (2:7) 


214 ( 3.0) 


Some ed after HS 


: : • 




. * ’ 






; ' 'P'X-\ ' 


State 


65 < 3.1) 


56(3.4) 


19 ( 2.9) 


' 31 ( 3.4) 


r 1 7 ( 2.4) 


: m(23) ; 




223 ( 3.4) 


221 (5,1) 




^ 217(3.9) 


• = ?r rn • 


;; ^**1 <rvx. 


Nation 


; 4.0) 


48 ( 3.1) 


29 ( 3.0) ' * 


26(3.0) 


AX2D ( 2.6) : 


26(:2;4) 




,;<222;( 2:5) i ; . 


227: ( 2,8) 


225(4.0) || 


0223 ( 32) 


|; 218 ( 6.5) 


> ; 216 (4.0) 


HS graduate 


]Q, ''w | : 


,7 




fjf®? •' ?'i -"r-> 


PiXt M 

: ■ 




State 


Sli8bi( 2'5) : 




X:, 22 (-1,7) ' '• 


:; : 1l :-29(:2;5)' 








209(2.1) 


204 ( 32) 


209. ( 3.7)' ftf: 


if! 194 (5.7) 


i 198(5.0) 


•'7195i0;3) :- • 


Nation 


53 ( 2.4) 


53(2.4) : 


26 ( 2.0): 1 1 1 


r - 25(1.8) 


• ? 21 (2.0) 


:23i( 2:o) . 




•21^ (2.7) , 


.214(2.6) 


211 (2.8): |v 


i-,; 209 ( 3.4) 


206(2.9) 


193 (37) 


HS non-graduate 


• AX" ■ ! 










• 7177' 


State 


52 { 4 St) : 


59 ( 4.4) 


1 27 ( 3.4) M 


21 ( 3.4) 


22 ( 317) 


020(8.4) 




1; 202 ( 3.7) ; 


191 ( 6.6) 4 - '' 




M T CV) • : 




7. 


Nation 


56 { 32) 


54 (i42) !7: 


: 24(3:1)^^ 


#t18(.2.7) - •: 


• 11. 1 ;i9,( 2.3) 


28i(.2:8);:7 




201 (3.0) 


. . 200(4.1) 


V.194|5i^l|l;- : 








1 don’t know 






.7 Ip 




illllilllS' iS: ■> 




State 




% sz-cmx : 


i 25{1^IIr 


•S->'26 ( i;:7) 




23(1^)j 




207 ( 2.1) 


*. 202 ( 2 3) : 


206 ( 2,1) : 


^201(3,4) : 


if 200(3^) : 


-193 ( 4:0) ! • 


Nation 


49 < 1:9) 




'29 **#{$*• 


27 ( LO) 


22 < 1J2) 


• 26 ( 152): : I; 




212(1.7) 


.. 


. 210 (2.0) i 


205(2.1) 


205 ( 2.4) 


i 196(2.4) 


GENDER 


5 .• r' ' m 


... , .» f.i. 








... . •; 


Male 




•• . X'- ■■ 


? • • . * ; 




> Hiiiip r '^-r' * 




State 


^tJ57ip.7) 


7 ; 




|l| 28(1.6)i| 


x^e(^s ) \ 


i23(1.4)> 

>' ~AV'& <: 


Nation 




% 206(3.6) i* , 

Lv- :49l(il4)iiS? 


4214(27)?® 

29(1.1) 1 


^ V201 ( 3,7) - 
f|>24(1,4):<^ 


202 { 2*9) > 

^;/23 (4;3). 


193 ( 4.4) 




213(13) 




■; 2l4;(2^;:jJ> 


^•2be.Ci,9);-l 


xyzoe ( 2.1); 




Female 




* , ' 




■y‘ - ■ •; ; 


7 7 •• * ‘ 


V' • •: 


State 


v; :62'{1.9) 


, 56?(&0) • 


.. 23 ( I S)-: f|l 


!H' 25(1,3) 


7.1:5 (1.1) 


190(115) 




7217(49} 


213i(24) 


. 218 ( 23) 


•; 215 (2.8) 


rf'204 4.4) 


2l0-(i37) 


Nation 


( 1.9) ■ 


52(45). 


28(i.3)r^i; 


26(1,1) v 


20 (1 2) 


i22|(^0):- i 




; : 220 ( 1 2) 


222:( 1 £) V 


.-222(1^1® 


1^221 (1.6) - 


Hr 214 ( 2:3) 


210f(2^ r 



SCHOOL TYPE 
Public 


. - •••; - 
*.i •*$**'> i;-. 






: \V'$ 






State 


' •i'f(r^T;~) 


' : si (i.6) i ■ ■ 


7- Ji-:r.'(=ss^) - - 




^•^s^ (s~s.=:) i ' 






; '~a (s^t.=) 


210 { 2.6) 


4 ==; (=^=) )7 ; 


7208(2.6) 


;;i’: ===== (s==s.ss) . 


201 (3.7) 
24 !( 1.0) 


Nation 


: :Jisxxsz (rss.r:) 


51 < i:3) 


• == (=.=:) h 


25(0.9) 


•■.K-iKssr (rss.-s:) 




.= (=r.=r) 


218(1.3) 


. === (==.•=:) f;: 


215(1.4) 


(=r=rj=) 


20341 ^) 


Non-Public 




: . 7j : 




" y fi ’ , 


7 ^ ' -• 


>■ v ' 4 > ' ; 


State 


. 52:< 4:9)77 : 


=ss (ss=^ ji" 


^729(7.8) 


P^SBSS (SKS^SS) ; • 


.;7 4f9 : ;(4l0)-' 




•4 (SSSS.’SS) 


236:(i6^)!:^; 




CS233 ( 85)1 






Nation 




; : 56^2 fyll 




28 (1.6) 


•|7sssst (ssisis:) 






: j jjss=: (ssr-.=r) • 


235 ( 2.3) 


’ sss».'(ssisf'|^ • 


• 231 ( 3.1> < : 5: 


I^ r**^*" 


7 ; ’.222 ; {l5l2). J 


Combined 


: • i ' 


•7 :• 4 ; '• 








. . , •• • : 


State 


(rr — r.~) 


53 ( 1.7) 




27(12) ! i 


==: (=s=^) 


’ 21 (:L 2 ) 




- ' —^7 (rrr-;— ) 


212 ( 2.5) 


=r=7 (=.=:) 


210 ( 2 ^) 






Nation 


2 -sr: ( — .-) 


51 


(ss=^=) ;; ; 


25 ( 0.8) 


:;.~a(=s=.=) 


724(1.0) 




rests: (s£ 2 r.=:) 


220(41) 


i’j 


216 ( 1 - 2 ) 




2 C© ( 1 . 8 ) 



=== School type results are not presented for 1992 since state-level non-public school data were not collected. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher Gower) than the value for 1992 at about the 95 percent confidence level. *** Sample 
size is insufficient to permit a reliable estimate. 
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TABLE D6.3C 

Public School Teachers’ Reports on Asking Students 
to Write About Something They Have Read 



1994 Trial State Assessment 



Almost Every Day 


At Least Once a Week 


Less than Weekly 


1992 


1994 


1992 


1994 


1992 


1994 



TOTAL 

State 

Nation 

RACE/ ETHNICITY 
White 
State 

Nation 

Black 

State 

Nation 

Hispanic 

State 

Nation 

TYPE OF 



LOCATION 
Central City 
State 

Nation 

Urb Frng/Lrg Town 

State 

Nation 

Rural/Small Town 
State 

Nation 



Percentage and Proficiency 



29 ( 34) 
214(3.6) 

: ;25 { 1.8) 
220 ( 2;7): 



24(2.7) 

mm***) ■ 

30 ( 2.4) 

ks)/ 



28 (34)' 312) 

225 ( 2.9) ^f 4229 ( 3.9) 
24 ( 2.4) .^|lM!:30i<;2.9) „ 
1 228 ( 2.7) - ;221::(2.3) 



' -129® 519) --./I 
I 19$ ( 5.8)1 l|! 
l!|25®4.p)|f 
192 ( 3.2) 

: ;:>24'< 3.3) : Hfeff 
|:2p$f3 4r;||| 

IS9D0ipt#l^i 

|Si?8fc0i)Pl l 

M; > 

:36i(:5.3)hfil| 

s ;224.<:3 .s) 

223 < 4.9)1 



il2e#3l2)JieiS 

28(4.3) 

186(4.2) 



Wm#?£ 

W?Mm : 

§3G':(3.1) ; 

>189(4.8} • 

37(6.0) 
196(8.4)! : 

lHijl 

1^30 (4i3) - " ""= 
il33®&9}>: & 

n ( 3.cfef| 

28(4.8} 



60 ( 2;8)i 

2li®i Is)-: 

:-216|?1;^ 
J ' 

222 ( l^ i 

■ 49:.(3;1):l 

223!(i^||| 

58(4.7) 
194 ( 2.$) 

t||j§9l p4)l.! 

rf184(>$ii)S 

• i ;53:;(:3ip 

[ 1202:(310)$ 



#i62#=3 i 

46® 413ft 
; •206 (34^. 

59lSd% 
215 (2.6)": 

iiMlifS. 

4220 { 2.3) 

lllsiife)-' 

213(211) 

4ral9V(M)| 



,/WJ 



|Mi 



» Ol 



■ ; j 

/-«' { lv 



59 ( 2.6) 
209 ( 2.6) 
56(2.3) 
!2131( 1;5) 



62 (219) 

222 ( 2.0) 
56(2.6) 
224(1.6) 

m m ^ 

1488 ( 3:3) |i§ 
4-56 :( (4:8) i 
^185;(:2,4) 

■53(4if=;1| 

186 (:*i3Sn>l 
57^1)1 
.1 90 ( 24) j.j§ 

Mf®§ 

:2021(3.7)iii 

%6li^8)-gi! 

^58®4.0) 

1212 £5.0)41 

' 52(<4>lft#t 

ftp 

1213^24)11 



-112 ( 2.3) 
210 ( 5 . 2 ) 
26(2.5) 
213(2.4) 



<223(4.6)1 
^!i27:(3.0) 
j|219,;(;2:8). ,, 

|S:(;3J2) :f 

-192(6.3)1 
26 ( 4.1) 
196(3.1)/ / 

||13 : ;(-413) V 

1123^2^8) - ;• 

g198:;(4.1) . : 



Wmt^m *& 

Mg 

li26^3.6)i;||J>»2:C2i2^ 

.205(3.9) <-.204(5.3) 



f '5 : 1(-1.3) vis r-'4l2 ( 

^^Pl( 4.8)1, 'r:/-223.(-3:i)1i® 



: 17(2.3) 
203 ( 3;7) 
14(2:0) 
21 5(2:6) 



17. ( 2;5) - 
/: 220 ( 3.8): 
iv;i4( Z4)i 

; : ;:^4:(2:3>,-r; 

19(3.5) 
;4; 481(4^/' 
15 { 3.3) 

^ 192(3.7)(; 

: /;#20K?iSp 

v; 13 (2.3) • 

rmmw$ 






l|22f 

W8W 3-2)1 1 215 ( 5.3}! | 



-, 8 .( 5_ 0) 



(continued on next page) 
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